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Accountability is nothing new on ther educational scene. 
Teachers have always been responsible for their professional 
acts and decisions and accountability is a new name for professional 
responsibility. 

To whom is the teacher responsible? This is a question 
with many answers. In general, the teacher must answer to others 
whether they be students, parents, administrators, or school board 
members representative of the general public. As a professional, 
the teacher must answer to his own competence and knowledge; in 
the classroom, the children are in the majority. This is no 
place for an educational vote on '^What knowledge is of the most 
importance?'* The children will be able to express their individual 
desires and interests. The teacher will be able to respond to 
these expressed wants in a way that can distinguish between what 
is good and v;hat is bad for a particular child, between what is 
really a basic human need and what is a passing imperative of an 
immature but maturing human being. 

Humanistic education is an approach to schooling that 
respects the individual human as being important : students are 
important and so are teachers. Himianistic education recognizes 
the need for qualitative objectives rather than merely mechanical 
and quantitative classroom goals. 



It might be asked, "Why the title, S avin g Educational 
Dollars Through Quality Ob j actives ?" This title was chosen to 
emphasize the most visible effect of quality objectives. It Is 
In no way meant to suggest that quality objectives cost less. 
In fact, they cost more in a wide variety of circumstances. This 
is simply because they are worth mere, 

A quality item can save money in a ^number of ways. 
Quality lasts longer; It can be modified to fit Individual circum- 
stances in ways that throwav;ay less expensive items can't. Quality 
is a more individualized approach; it can be adapted to large 
numbers in ways that avoid the stereotyping of mass-production. 

Clarity in a quality objtBctive means that it can be 
understood by the man in the street and by the expert; there is 
no need to cloak meaning in terms known only to the highly 
specialized researchist. Accessibility in a quality objective 
means that it can be bounced around and compared on more than a 
local or provincial basis; people do learn from one another in a 
basic feedback, approach provided a basis for communication is set 
up; professionals need to know v;hat other professionals are doing. 
Evaluation in a quality objective means that it can be assessed 
by anyone of reasonable i'ntelligence ; similar co the situation at 
a sporting event, the non-athlete who knows what is going on is 
able to come up with evaluative judgments based upon objective and 



impartial visual inspection; there is no need for a semi-mystical 
approach when worthwhile goals are expressed in comprehensible 
language. Accountability in a quality objective means that teachers 
are aware of the educational issues in question; they know how to 
recognize quality when they see it; there is no need for policing 
by outside forces since self-regulatioii is often more demanding; 
this is especially true when it is done on an individual, voluntary, 
and confidential basis. 

Clarity in. a quality objective helps the student understand 
what is going on in the classroom; this indirectly helps the funding 
of the school since the average concerned parent will make financial 
sacrifices for his child* s education if the education received is 
perceived as valuable; even the best goal in tlie world will not be 
appreciated if it is not understood. Accessibility in a quality 
objective helps the teacher learn what his colleagues are doing in 
similar situations; this indirectly saves money by avoiding- needless 
duplication and by the adoption of goals and techniques found to be 
effective- in terms of learning and cost-analysis; it doesn't mean 
spending less money on education; it means spending educational 
dollars more wisely. Evaluation in a quality objective means that 
the desired degree of excellence is spelled out for teacher and 
student alike; there is no greater waste of educational dollars 
than instruction which misses its mark; once the student knows 
exactly w;hat is expected of him, he is more likely to perform, in a 
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manner that will satisfy both himself and his educators whether 
they br'teacher, parent, or society. Accountability in quality 
objectives means that dollar cost is not the primary consideration; 
humanistic growth and development is worth much more than the money 
invested in fostering them; as a matter of fact, it can be argued 
that even from* the dollars and cents point of view, funds placed 
into education yield mere in terms of long-range payoff; as in 
any educational situvition, it is the final results that count. 

Merely cutting corners in education is evidence of fiscal 
austerity and not necessarily of educational planning. Quality 
objectives are based upon the assumption tfiat curriculum 
development is basically staff development; staff development can 
then be seen in the light of performance objectives as the ability 

to spell out educational goals in understandable language and in 
such a way that eventually someone will be able to objectively 
declare a particular educational effort a success or a failure. 
Quality objectives will cost a lot of money, but eventually they 
will come up with better analyses than "We need more money," or 
"We need more time,'.' or "We need more personnel." 

When educational dollars are seen as catalysts or 
means to ends rather than panaceas, then the general public will 
be able to invest more dollars in approaches seen to be successful 
from a number of points of view. Whether you call it "quality 
objectives" or "saving educational dollars," it is an approach 
that needs to be observed and pondered in a time when human ability 
and potential as well as public funds are recognized as natural 
resources that must not be wasted. 
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NOTE : How T his D ocument Came into Existence 

Basically this document is a collection of v;orking 
papers written to fill specific needs of teachers starting to 
think about and write performance object ives . Some of these 
sections were developed at one or more seminars and discussions 
on the implementation of a process to improve classroom 
instruction. It v;as felt that the front lines of education are 
to be found In the classroom and not in the curriculum guides; 
similarly, the place to test out new Ideas in education is not 
in a psycliological laboratory but in the classroom in front of 
real and often, unpredictable students. Similarly, the desired 
objective of all this work was not the discovery of a method or 
of a perfectly formulated objective; v;hat was sought was a process 
of introducing objectives into the classroom in a format which 
could benefit from the experiences of hundreds of teachers trying 
to make their instruction more relevant. 

It was not felt that educational progress meant an immediate 
or drastic change in the way things were to be done. Innovations that 
become progress have a quiet v^ay of gradually inserting themselves into 
the classrooms of teachers who are not satii^fied with their past 
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successes. Teachers like this have empirically discovered their 

own individual way of testing out tentative but clearly defined 

approaches to deal with classroom objectives : this applies both 

to objectives that can be pre-planned with precision and to 

objectives that seem to emerge with serendipity* Society needs 

both kinds of goals : it cannot afford to have '^creative spellers" 

or "imitative thinkers." 

Re-reading each of the following sections makes clearer 

and clearer that certain yalues were almost unconsciously smuggled 

into the text. To avoid any misrepresentation, here are a few of 

them for consideration : 

» Not all teachers v;rlte their classroom goals; this does 
not mean that Lhose teachers have not thought about 
instructional objectives. 

& Sometimes the opponents of performance objectives have 
>" . more insight into v;hat is really wanted as a result of 
all the discussion and writing of course objectives. 

o This is especially apparent v;hen it comes to the writing 
of objectives for even one course. If everything to be 
taught had to be written out, the paperwork would be 
impossible to manage. 

o Seen in this perspective, writing performance objectives 
really means writing the most important anticipated 
outcomes of learning. 

o In practice, this means selecting from the work of 
others and writing a few objectives to meet the 
needs of both individual students and of individual 
teachers in a particular local situation. 

9 Since it seems obvious that many teachers base their 
classroom performance upon how they were taught, it 
would seem that, if any system of performance objectives 
is to succeed, it must be based upon the shared 
experiences and objectives of many teachers teaching 
the same or similar courses. - , 
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e Not surprisingly, the more one leaves the realm of 

elementary and psychomotor objectives, the more difficult 
it becomes to pre-specify educational gocils. This does 
not mean that a goal which can't be precisely spelled 
out must be excluded from the curriculum. 

9 It is to be expected that many teachers will start 
writing performance goals of a very poor quality 
when considered from the viewpoints of relevance 
and specificity. Thesd^- goals are- not to be rejected 
by a school; they should be accepted and improved 
in an atmosphere which encourages colleague collaboration. 

o Literature on behavioral and performance objectives 
is quite well written and convincing. However, when 
it comes to actual implementation, the process of 
clearly specifying objectives is one that can lead 
to a number of excesses that can interfere with the 
main job of a teacher . 

o ^1'hus , it must be recalled that the main job of a 
teacher is making sure that his students are 
learning. No matter how he does it, a teacher 
is teaching when his students are learni^ng. 

o If such things as the wriD-lng or choosing of goals 
or objectives interferes with this teach ing- learning 
process, then writing and choosing must be subordinated 
to the primary objective of increasing learning. 

The following pages were written to share with you an 

approach that has been found helpful in getting teachers to start 

clarifying their classroom objectives in such a way that they can' 

share their classroom discoveries with other teachers. It is hoped 

that reading it will help you share your classroom objectives and 

experience with others. 
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Specifying 
What 

An Educator 
Is Trying 
to Do 



DEFINITION : What Is a Performance Objective ? 

One of the key concepts taken for granted in the following 
pages is that of "performance objective" or "behavioral objective." 
Tlfis concept is often associated with such things as criterion- 
referenced objectives, built-in evaluation, terminal student 
performance, and- performance-oriented objectives. For the purpose 
of this discussion, all of these terms are assumed to be practically 
synonymous even though each emphasizes a different aspect. 

t A performance objective is defined as a statement of an 

educational goal or objective in such a way as to clearly answer 
three questions about the teaching-learning-evaluation process : 

o Exactly what will the successful student ^ 
be expected to do? 

0 What materials .and what procedures constitute 
an integral part of this student performance? 

o How will one know when the student 

is performing this goal successfully? 
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Implicacions of This Definition 



Performance objectives tell the student 
or trainee what it is that he or she will be 
expected to do^ when he is evaluated, the 
conditions under which he will have to 
perform, and the level, exten t , or quality 
of performance expected. 

To meet the standards herein spelled out, 
,such an objective must be written in 
I'anguago that is clearly understandable by 
students, trainees, and the general public. 
Straightforward language works better chan 
scholarly and obscure terminology as a 
vehicle with which to v;rite objectives, 

A well-written performance objective 
should do three things: 

1st 9 It should clearly indicate 

what it is that a student who 
has mastered the objective 
will do or perform . 

2nd 9 It should say under what 

conditions the student will 
be expected to do this. 

3rd o It should say to what extent 
or degree of excellence the 
student will demonstrate his 
ability to perform. 

The mere act of v^riting ' objectives will 
cause most teachers to come to grips with 
,; what they are trying to do in the classroom. 
"This is a positive step towards relevant 

instruction. It also will give rise to an 
"important question in making instruction 
more effective, "What materials and what 
procedures will best help the student attain 
objectives commonly agreed upon as relevant?" 

This document will center on writing 
objectives and on working them into an 
integrated system. However, it must always 
be kept in mind that writing is the means 
to'other goals, e.g, the development of 
goals meaningful both to student and to 
teachers and the evaluation of methodology., 
in order to improve instruction, to name 
•only two examples* 
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The Rationale Behind Performance Objectives 

Performance objectives are statements 
which describe what successful students wil 
be capable of doing at the conclusion of a 
particular learning unit. 

o Properly written performance 
objectives leave no doubt as 
to what is expected of the 
trainee at the end of ~t'''^^^^ 
ins truction, 

• These objectives do not try 
to dictate to the teacher 
the methods to follow or the 
classroom procedures to 
employ in his teaching, 

o However, they do eliminate 
haziness about what is to be 
accomplished. 

There is nothing new/or extraordinary 
here. Experienced teachers have been doing^ 
this even though they have not alv^iays put 
it down on paper. Writing goals encourages 
feedback from other teachers. When one 
starts exchanging professional ideas with 
colleagues, suggestions anc3 improvements 
start to emerge in an atmosphere of 
enthusiasm. The following sections which 
spell out exactly what is meant by 
performance, conditions, and extent are 
intended to help teachers get started 
expressing, writing, and choosing their 
objectives. 



Components of a_ Well - Written Objective 

A well-written performance objective 
•^-should spell out three things: 

o the performance expected (an 

observable activity demonstrable 
by the learner) 

• the conditions wherein the student 
will have an opportunity to 
demonstrate the newly acquired 
behavior or performance 

© the extent or degree of the expected; 
student performance which will serve^ 
as the evaluative criteria to asse:SS 
the anticipated performance. 



What Is Meant by " Performance "? 



What Is Meant by " Conditions "? 



Performance can be equated x^lth doing. 

If performance is to be measured, it 
must be observable. 

In other words, a statement of 
I'- .^'ormance must specify an activity 
thcia can be observed directly. 

Such verbs as "know, comprehend, and 
understand" specify activities that can 
only be inferred or seen indirectly. An 
objective is more clearly v?ritten v?hen 
other more visible and more observable 
verbs are used: - j 

o A teacher who says he wants his 

students to "understand" carburetors 
is less clear than 3 teacher who 
wants his trainees to be able to 
"clean" a carburetor. 

o Similarly, the teacher who says 
he wants his students to learn 
how to "subtract" two digit numbers 
is more frank in the same circumstances 
than the teacher who claims for his 
goal "a deeper understanding" of 
mathematics . 

Neither of these last tV7o objectives 
is faultlessly written; the conditions and 
the extent of the desired student behavior 
are not spelled out, to name only two 
possible sources of improvement. However, 
the change from an abstract verb. to a more 
specific verb has improved the visibility 
and observability of the intended 
instructional objective. 

• It is much easier to recognize a 
' student that can "read" voltmeters 

than a student who "understands" 
measuring instruments. 

6 A"student who can "re-wire" a 

defective motor is more observable 
than a student who can "comprehend" 
the principles of electric motors. 

Even the word "know" will have a 
different meaning to a teacher who relies 
upon "memory" questions and to a teacher 
who relies upon "brainstorming" techniques. 
It is helpful to the student if these 
differences are spelled out. 
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Conditions refer to the circumstances 
in which the student is expected to perform 

Every situation wi],l have its own 
given restrictions which can range from 
such obvious things as "paper and pencil" 
and "common tools" which need not alwaysi 
be stated to more complex measurement 
questions ""such as: 

e Will this be an open or a closed 
book examination? 

e Must the student vjork strictly 
from memory for formulas and data 
or will he be allowed to use 
reference tables? 

When the student identifies the 
resistors vjill he work from memory 
or with a color guide? 

Each of these and similar questions 
about conditoiis are important since a 
change in the details of performance is 
often directly associated with a different 
type of cognitive functioning. 

What Is Meant by "Extent" ? / 

Extent refers to how well the student 
is expected to perform. 

This can be expressed in a number of 

ways; 

© minimum stand-ards. 

® maximum number of permissible errors 

© specification of time standards 

0 tolerance 

• definition of correct or successful 

9 expected percentage of success 

« minimal number 

« degree of excellence 

In. other words, this is an attempt to 
make as specific as possible the evaluative 
criteria that will be used to assess the 
performance. 
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An Analysis of Performance , Conditions , and Extient: 

Do - - - Expressing Objectiives in Terms of SCudent Perf orma nee 

Some school curriculum guides use words such as "understand, 
appreciate, know" to express their objectives. 

From the point of view of behavioral objectives, the difficulty 
^v'i th these verbs is that the performance is not directly observable . 
These verbs do not tell what the student or trainee is supposed to 
be able to do as a result of this knovj ledge . ' 

Conditions - - - Specifying the Exact Circumstances Under Which 
^ ~ -i-^ ^^^^ Performance Is to Take Place 

Obviously, each set of circumstances that one might develop will 
make its own specific demands upon the learner who attempts to accomplish 
the objective. 

The idea is not to end up with several hundred specifications for 
every objective in each section of a course. The idea is to start 
specifying clearly the types of conditions under which the student will 
be evaluated. Once this approach enters a teacher's lesson plans, he 
will inevitably make /his teaching both more concrete and more interesting 
because of its practical and operational orientation^ . 

Ex tent - - « An Evaluative Measure of Acceptable Performance 

Some of the more obvious approaches are time limits, error counts, 
percentage correct, minimum number, or accuracy. The emphasis is on 
the degree of excellence to ^e demonstrated by the student rather than 
on how the trainee acquired the ability to perform the skill. 



FEEDBACK : Translating This Definition 
into a System That Permits 
Teachers to Look over the Shoulders 
of One Another 



Writing objectives in concrete and clear language 
has been going on fbr a long time in occupational and vocational 
education. There has never been any shortage^^bf paperwork 
documentation in this area. 

Too much effort is required to turn out good performance 
objectives ^if they are simply going to sit around on a library 
shelf somewhere. What is proposed here is a method whereby 
teacjiers can find out 'what is being taught in classes similar to 
to their own. In this way, they will be able to improve their 
classroom instruction through awareness of what others are doing. 
This is the heart of any feedback system. 



Qb iectives Evolve Once They Are Written 

The question arises, "How does the 
average teacher with many time-consuming 
obligations develop his objectives?" 

The following section is not meant 
to give a theoretical model of how to 
develop performance objectives in the 
framework of a feedback system. It is 
meant to tell the story of six teachers 
who tried to develop a course in auto 
mechanics. The idea came to them in 
the course of a one day training session 
on hov7 to write performance objectives. 
Most of their* feedback was accomplished 
by exchanging photocopies of their 
objectives with each other through the 
mail. These six teachers did not make 
use of computerized classification and 
feedback systems. However, the same 
principles apply to their primitive 
collaboration as v7ould apply to more 
sophisticated computerized systems 
mentioned in later sections. 



\^iat These Teachers Wanted to Happen 

It would be hard to pinpoint the 
exact motivation of each teacher. A 
look at their comments might give some 
idea of what they wanted: 

® "I want to find" out how other 
teachers break this course down 
into instructional blocks." 

© "I want to find out what teachers 
in a similar type community and 
school situation are doing." 

o "I am not satisfied with my own 
programs and I want to find out 
what others have found to work." 

In a few brief words^ each of these 
teachers was looking for feedback. The 
idea of writing objectives v;as simply 
a means to get there. The format of 
performance objectives adds the dimension 
of percision to this necessary teamwork. 



Step One -- The Tally Sheet 

The first thing these teachers did 
was to exchange information about course 
titles and ma j or subdivis ions . This 
soon made it obvious that local situation 
was a little bit different: each teacher 
took individual approaches to the same 
course . 

In order to find common territory, 
each teacher wrote down the major blocks 
that mapped out the work, from September 
to June. For most teachers, this 
represented about ten to fifteen major 
subdivisions within his course. 

After this v;as done, it became 
evident that there were major terminology 
variations. A little bit of explanation 
made it clear that there was about sixty 
per cent commonality in what was taught 
by each teacher. Commonality meant .that 
several teachers had similar names and 
similar content for their blocks. The 
other course objectives were addressed 
to local needs and were not always 
covered by a majority of the six. 

It was interesting to note that 
each teacher had his own particular way 
of breaking down the subject matter: 

o Teacher A relied upon task 

analysis and job requirements. 

o Teacher B tended to have a large 
number of separate blocks which 
were centered around each part of 
the engine and transmission. 

G Teacher C seemed to think in terms 
of marketable skills. 

o Teacher D thought in terms of 
job families and related skills. 

0 Teacher E felt that students 

should be exposed to theory first 
and machinery later on. 

o Teacher F didn't give too much 
thought to course sequence since 
he preferred to rely on typical 
production demands as cars came 
in to be repaired. 



Step TX'io " - A r e ne s s of Local l^eeds 

The teachers found out that one way 
rigid programs failed to meet varying 
local conditions was by attempting to 
set up the same curriculum blocks for 
all schools and by ignoring the necessary 
adaptations to meet varying local 
requirements . 

At first, three or four of the 
teachers thought it would be a good idea 
to have all students exposed to exactly 
the same instructional goals and nothing 
else. They thought this would give a 
sound statistical basis to their work. 
When the topic of individualization came 
up, such a monolithic approach wa^ seen 
to be humanistically unworkable. 

Up to this time, local decision 
making had been on a very perfunctory 
level. It usually consisted of a number 
of gimmicks in order to get the largest 
budget possible. When seen from the 
viewpoint of six different schools, it 
often happened that large amounts of 
money were spent separately^ by each 
school to develop identical or at 
least.A^ery similar programs. This v?as 
both time-consuming and very expensive; 
its result was needless duplication for 
those objectives which V7ere taught by 
several schools ^ The same work V7as 
done over and over again ^without being 
shared with other schools. 

The teachers came up with a 
solution. It was a decision to share 
common course goals o Goals not common 
to several schools would not be abandoned 
or overlooked. The unique adaptations 
v/ould be based upon educational benefits 
as the criterion rather than merely 
cos t -account ing. 

If a goal or an objective was found 
necessary to meet local needs, its 
expensive development price tag would 
not be considered the reason to postpone 
its implementat iono The economics made 
in exchang:'ng common core objectives 
between similar programs would free local 
funds to focus on meeting local needs. 
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Step Three - -WritinK the Objectives 

Once the course had been broken down 
into blocks, it was found helpful to ask 
this question. "What are the two or throe 
most important objectives of this particula 
block of instruction?" rather than "Have 
all the poss ible objectives for this 
particular block been listed?" 

The reasons for this are obvious: 

0 Concentrating on a few objectives 
enabled the teacher to stress 
educational values rather than 
paperwork. 

o Teachers would then be able to 
think in terms of the big picture 
rather than in day-by-day or 
minute-by-minute miniaturized 
ideas . 

c Feedback vjill almost be certain 
to occur. When one teacher saw 
only one or two principa.1 
objectives of another teacher, 
he began to not ice that he 
himself had chosen another 
aspect as more important. 
Since the other teacher was 
also experienced, he began to 
ask himself quite seriously 
who had made the better choice. 

9 Rather than worry about doing 
all this writing himself, the 
typical teacher found out that 
he was able to share his own 
ideas and :to borrow those of 
others ♦ 

© The emphasis was on selecting 
the most effective objectives, 
no matter who had written them. 
This placed each teacher in the 
right frame of mind to begin' 
improving his own performance. 

9 One of the difficulties of the 
modern communications gap is 
having too much information. A 
.hundred objectives would have 
been too much for these six 
teachers to handle at one time* 
Tv7o or. three objectives every two 
weeks from each teacher was found 
to be quite manageable. 
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Step Four - Bouncing Objectives Around - 
This is a process that requires the ability 
to give and take. Sometimes, the teacher 
defended his o\N?n objectives; other times, 
he acknowledged that his colleague had 
really done a better job. 

Teacher A'wrote, "Given a malfunctioning 
valve, the student will be able to 
repair it in five minutes or less."' 

Teacher B v;rote, 

"CONDITIONS: Given an automobile, 
reference manual, fender covers, 
tachometer, and screwdriver, 

PERFOR>:lANCE: The trainee will adjust 
the idle to factory specifications 
and normalize the engine, 

EXTENT: Within 25 RPM and demonstrating 
all safety rules . " 

Teacher C wrote, "My students will be 
able to get a part-time job 
Saturdays after school earning 
about $2,00 an hour after t:hree 
months of instruction; they should 
be able to earn about $3.50 an 
hour after another three months 
for a B grade. Those who make 
more or less'will get A's or C's." • 

Teacher D wrote, "Once the student has 
demonstrated the ability to do a 
grease job, he must be able to give 
snappy service which impresses the 
customer with his promptness, speed, 
accuracy, and interest in doing a 
good job . ^' ^ 

Teacher E wrote, "Every student is to be 
. able to tell, in terms of physics or 
mechanics, exactly why he turns a 
scre\\i or makes an adjustment. It is 
not enough to merely do the right 
repair; the student must always be 
able to think and to tell why; this 
proves he has thought.'* 

Teacher F wrote, "The. student must realize 
that after every repair job, the car 
must be cleaned and given the 
appearance of being fresh off the 
assembly line even if thi^ means 
washing it after an oil change." 



Step Five - The Interaction - Without 
realizing it, each teacher had some insights 
and some blind spots. In the exchange of 
objectives via the U.S. Mail, each teacher 
came to acknowledge a bit more of his 
expertise and also his limits. . Each had 
something to teach, but also something to 
learn from the others. 

Teacher A - Quality and Time - 

Teacher A jumped on the objectives of 
teachers C, D, and E for lacking any 
conception of quality and time. 

He did admit that his objectives 
needed more life to make them more 
interesting -to the life style and 
hazy career goals of his students. 



Teacher B - Format and Analysis 

Teacher B was congratulated by the 
group for having devised a format which 
emphasi2ed the three essential elements 
of a properly written objective. In 
general, most of the six teachers 
approved of the simplicity and clarity 
introduced by his approach. 

Further study of his objectives 
revealed a few errors that could be ^ 
easily corrected by proper editing : 

© "to factory specifications" should 
be in the EXTENT and not in the 
PERFOmNCE section 

o "and normalize the engine" should 
be a separate objective and not 
tied on to the adjustment of the 
idle. 

This last suggestion was- not accepted by - 
all. Some felt it should be an integral part 
of the idle adjustment while others felt that, 
for learning purposes, the two should be 
separate. 

As the objective was further analyzed, 
some felt that safety rules were common- to all 
operations and should be made into separate- 
objectives that could provide the introductory 
classes in all occupational areas. 



Teacher C - Relationship T3et:v;een Education ^ 
Skill , and Income - 



It was quite obvious that teacher C 
did not have much trouble motivating 
his students and traineen. He himself 
tried to oversimplify his approach which 
placed quite a bit of emphasis on getting 
a job employing the skills learned. 

The source of student motivation 
was not so much money as the growing 
•insight teacher C developed in his 
students tliat school can improve 
skills. Their own practical work 
experience showed them that skills 
combined with knowledge of on-the-job 
opportunities can help a person 
advance up a career ladder. 

In retrospect, teacher C did admit 
that he actually used other bases for 
-his grades and report cards than student 
salaries. He also felt that in this 
area he had been helped by the free 
exchange of objective criteria now 
easily available from the other teachers* 



Teacher E-- Cognitive Domain 



Most of the other teachers were 
impressed by the vast scientific 
background of E. He. had built up a 
Collection of workable slides and 
models which the other teachers 
wanted to borrov, to use in their 
explanation of the scientific 
principles underlying the everyday 
auto repair skills . 

One university and one publishing 
company approached E and asked him to 
set up a common core for all occupationa 
students in physics and to vjrite an 
illustrated text • s tress ing skill and 
understanding. 



Teacher D; - Affective Domain - 



Most of the other teachers had taken 
attitudes for granted. It had been assumed' 
that the student would naturally pick up 
these necessary components of successful 
functioning in a job. 

Teacher D did admit that he needed 
objectives in the cognitive and psycho- 
motor domains. Until now he had never 
had a readily available source of them. 
Rather than have to write all of them 
himself, he was quite happy to profit 
from the work of the group. 

Similarly, the group was quite 
interested in the various ways he had 
accumulated a vast array of practical 
ways to instill punctuality, cooperative 
work habits, teamwork, safety conscious- 
ness, acceptable appearance, honesty, 
trustworthiness, care of tools and 
equipment, compatability wich fellov; 
workers and supervisors, responsibility, 
indus tr iousness , and record -keep ing. 



Teacher F — Customer Sa tisfaction , Job 
Families , and on - the - job Training 



The explanation made by F that 
students really need little more from 
a course in auto mechanics than the 
ability to learn on the job was not 
accepted at all. 

However, his concept of job 
families was seen as an inevitable 
outcome of the fact that most humans 
do want a bit of change after polishing 
a skill to the point that it can become 
merely a dull routine from which 
repetition has removed its first glamor. 
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AWARENESS : The Possible Advantages and Implicattons 
o f This Systems Approach Coordinating 
e Classroom Teaching 
• Evaluation , and 
a Feedback 



Once a school starts thinking about performance objectives, one 
of the first questions it asks is ''What benefits will our, school receive 
from all this work?" 

\ 

Once a school starts making specific plans about writing performance 
objectives, it beginr: asking another question, "What will happen to all of the 
work we have put into the project?" 

There are many answers to these questions. The following pages 
are intended to give some idea of the dimensions that begin ,J^o operate once 
a school starts thinking in terms of a systems approach to classroom instruction 
rather than confining itself to one teacher or to one subject matter at a time. 

It must be remembered that local educational agency will have its 

own individual adaptations and that this listing is only indicative of what 

1" 

to expect in the..imajority ot cases. 
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Course Content 

Schools can identify their course content 
by specific behavioral objectives instead of 
by vague general descriptions. 

This makes it clearer to both the teacher 
and student exactly what is expected of each. 



_ .Piiblishin^ SuP-nrt _eyond Textbooks 

Once commercial textbook and media 
producers are informed of what is needed, 
they will be quick to solve the media support 
needs of those performance objectives having 
the widest market appeal. 

Probably, they will evolve a very practical 
and perhaps simplified coding system that will 
tell classroom teachers at a glance what can 
be obtained to make their ^teaching more 
effective , 



Revis ion and Updating of Curricula 

Some schools feel it is easier to 
restrict changes in their curricula to a 
half-dozen clearly defined performance 
objectives that need updating rather than 
to start all over again from scratch. 

This does not mean that only surface 
change will result. It means that a clears 
distinction will be made between long rang( 
strategies and short range tactics. 

Similarly, curricula committees will 
realize the need to revise yearly rather 
than merely conducting self-studies every 
half dozen years or so. 



Loc al Med i a Support 

Similarly, the school library and audio- 
visual department should be able to precisely 
identify literature and periodical needs 
according to the subject matter and number of 
students pursuing a specific codified perfor- 
mance objective. 

When these local needs cannot be met 
commercially, the lo.cal staff can begin to 
solve local demands rather than merely dupli- 
cate areas that can be handled more economi- 
cally by larger units. 

Budgetary Support 

Once a teaching-learning media has been 
found to improve learning, as measured by 
hard data rather than by teacher-pupil- 
s-alesman enthusiasm, it would seem likely that 
even the most cost-conscious school 'board will 
approve appropriations that yield a higher 
amount of learning per dollar in less time. 



New Curricula 

Some schools are requiring that all ne^ 
curricula be expressed in performance 
objective terms. 

This makes it easier to make sure ther< 
is not unnecessary duplication. It also 
avoids needless ambiguity as to exactly whi 
is being added to the curriculum. 



Course Prerequisite 

Traditionally, course prerequisites have 
been expressed in te-rms of course numbers 
th5t must be taken before a particular cours 

Sometimes students who have taken a 
particular course do not have all the specif 
skills for the next course in sequence. 



This is a simple application of the current prevent this, some schools are spelli: 

stress on accountability. prerequisites in terms of specific per- 

formance objectives met rather than in terms^ 
of course numbers. 
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Modular Use 6f Performance Objectives - 



ArticulaCion and Feedback Between Schools 



A curriculum can be viev;ed as an assembly, 
of courses each of which contributes to .the 
desired end -prod uc t . 

This assumes that each essential component 
c-an be prbvided by one or more courses. 
Depending upon the course content, this may 
or may not meet the requirements of the 
s'tudent following a particular curriculum. 

The construction of performance goals for 
instruction based on anticipated terminal 
capabilities allows for the expression of 
course content in clear and unambiguous 
language. 

A collection of closely related perfor- 
mance objectives is called a module. 

As selfstanding building blocks, modules 
provide a flexibility necessary to prepare 
students for more precise career ladders. 



Modules and Occupational- Goals 

If course content is identified in terms 
of performance objectives, the segments of 
a course can be used in a number of ways. 
Utilizing such a system, it would be possible , 
to identify the particular welding skills, 
machine skills, layout skills, or the like, 
needed for performance in a particular job 
^ family. It v;ould not be necessary to take 
full courses in each area. 

This approach would aid individualisation 
and personal counseling, and realignment of 
goals would be easier since students would not 
be* locked into a program. Goal aspirations 
could be modified upv;ard or downv^ard as 
competencies are revealed through ^frejjuep^^ 
checks on performance. 

One form of developing these specifica- 
tions is known by the names of "performance 
objectives" or "behavioral objectives," When 
a group of related performance objectives are 
grouped together in an instructional unit, 
a Module" emerges , 



Programs in different schools often have 
che same course names even though the per- 
formance objectives actually taught and 
evaluated are quite different. 

Real feedback and program improvement v;i 
be more likely to occur when classified per- 
formance objectives rather than course names 
are compared from school to school. 



Tests for Locally Developed Curricula 

Once the performance objectives are 
codified with regard to conditions, perfor- ' 
mance, and extent, it is possible to apply 
the same coding to corresponding test items.; 

Instead of a general test score, each 
student will receive a profile and a detailec 
analyses of hUi strengths and weaknesses. 



Teachint^ Aids 

The same coding system can be applied to 
teaching aids which will be for a specific 
performance objective. 

In this way, the teacher will have some- 
thing that is precisely tailored to what he 
vjants for a particular objective. 



Ind ividualized Instruction I 

Once the curriculum is thought out in 
terms of performance objectives and capabiliti 
instead of in terms of courses, the high schoo 
counselor is in a position to allow for indivi 
dual differences by the flexibility permitted 
after the achievement of each objective^ 

When such a redesign is complete, it 
would be possible for a student to learn at 
a rate that maximizes the benefits of instruc-' 
tion because it takes account of the learner's 
most effective style of learning. 
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AWARENESS: The Possible Advantages and Implications 
of This Systems Approach Coordinating 
c Classroom Teaching 
© Evaluat ion , and 
• Feedback 



Once a school starts thinking about performance objectives, 
one of the first questions it asks is *'What ^benef its will our school 
receive from all of this extra effort?" 

Once a school starts making specific plans about writing 
performance objectives, it begins asking another question, "What will 
happen to all of the work we have put into the project?" 

There are many answers to these questions. The following 
pages are intended to give some idea of the dimensions that begin to 
.emerge whenever a school starts thinking in terms of a systems approach 
to classroom instruction. A systems approach simply means going beyond 
piecemeal decision making. 

It must be remembered that each local educational agency will 
have its own individual adaptations. This listing is only indicative 
of what to expect in the typical case. 
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Specification of Course Content 

Writing a curriculum in performance 
objective terms is not an easy t(isk. This 
is a job that takes, much time and effort. 
Here are a fev? of the benefits that could 
result from this extra effort. 

Schools could identify their course 
content by specific behavioral objectives 
instead of by vague general descriptors, 
-Much of the traditional fuzziness in course 
description would be removed if this 
approach v7ere used. 

Both teachers and students v?ould have 
a clearer idea of exactly V7hat is expected 
of each other. -Employers \N?ould have 
better guides as to exactly V7ha-t v7ould be 
meant by such things as a high school 
graduate* Rather than specifying four 
years of attendance, a diploma and 
transcript would Indicate the ability 
to perform certain activities. 

A typical result: Course titles 
could convey more content information. 
Stenography I might be renamed Non-Legal 
Stenography; Stenography might be renamed 
Legal Stenography if the goals attempted 
justified such a change. 



More Relevant Instructional Goals 



Relevance is a word with many 
different connotations. Basically, 
relevant instruction is instruction that 
has some significance or meaning for 
students, teachers, and society. 
Irrelevant instruction is just the 
op-posite; it has lost its meaning or 
importance , 

It is an educational truism that 
instructional procedures which were once 
relevant can become irrelevant with the 
passing of time. It's not so much that 
the instruction has changed; the times 
have changed and left it behind. 



A typical instance: Broad general 
e^ducational goals are so vague that it 
is often possible for these goals to 
remain officially unchanged even in the 
midst of dramatic classroom changes. The 
reason is simple; these goals are often 
so imprecise that it is difficult to know 
specifically V7hat they envision for 
s tudent emplementat ion; goals, are o f te n 
so ambiguous that diametrically opposed 
student performances can be included 
under the same umbrella. 

Stating a goal in performance terms 
means that the anticipated student 
■performance is unambiguously stated. 
Thus, when a different student performance 
or accomplishment is des ired , the goal 
must be ^reformulated accordingly to 
reflect this change of aim. 



R evision and Updating of Curricula 

Some schools feel it is easier to 
restrict changes in their curricula to 
a half-dozen clearly defined performance 
objectives that need updating rather " 
than to start all over again from^scratch. 

This does not mean that only surface 
change will result. It means that a 
clearer distinction will be made between 
long range strategies and short range 
tactics. 

Similarly, curricula committees 
would realize the need to revise yearly 
rather than merely conducting self- 
studies every half dozen years or so. 

A typical example: Rather than 
completely revamp the curriculum when a 
new process is developed, it would be 
possible to pinpoint all those objectives 
which ' involved the now outmoded procedure. 
Each of these goals would be modified in,., 
such a way as to incorporate new tech . 
technological advances. In this way, 
classroom instruction would be kept 
up-to-date. 
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Modules Instead of Semester Courses 



Tests for Locally Developed Curricula 



In the middle 1800' s, the typical 
curriculum was conceived ir terms of a 
year's work. In the late 1800's, the 
typical program was broken down into 
an assembly of one semester or two 
semester courses, each of which 
contributed to the desired end-product. 

Sometimes, a one-aemester course 
-covers more subject matter and objectives 
of a particular student. The trainee 
finds himself in the situation of 
being obliged to take an entire one 
semester course when all he really 
needs is the mastery of a half-dozen 
related performance objectives. 

It is not always easy to specify 
how much of a course a student needs 
to be ready for entry-level employment. 
One form of developing these specifications 
is known by the name of "performance 
objectives," When a group of relaxed 
performance objectives are grouped 
together in instructional unit, a "module" 
emerges. As selfstanding blocks, modules 
provide a flexibility necessary to prepare 
students for more precise career ladders. 

A typical example: Students v?ho 
will need ony^ tv;o or three basic welding 
skills have often had to obtain them in' 
the past by taking a one or a two 
semester welding course. Rather than be 
forced into a situation v^here lack of 
motivation could lead to discipline or 
learning difficulties, a thirty hour 
welding module spread out over a six week 
period could do a better job. The 
particular welding skills, machine skills, 
or the like needed for performance in a 
particular field would be identified and 
taught in a concentrated minicourse. It 
would not be necessary to take full 
courses in each of these areas. 
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A curriculum , spelled out in terms of 
performance objectives would be able to 
draw upon banks of correlated test items 
developed and pooled by schools and 
teachers V7ith similar goals. 

In the case of strictly local goals, 
the school staff would be able to spend 
more time constructing test items 
designed solely to measure local goals. 
Since each of these newly constructed 
items would be attached to a specific 
instructional objective, each student 
could receive more than a total test. 
Each trainee could be- able to obtain a 
profile and a detailed analysis of 
strengths and weaknesses. 

A typical situation: A teacher of 
Auto Mechanics would obtain 607o of his 
test items from other schools covering 
the same general goals. 307o of his test 
items measuring local goals would be 
selected from local files. 10% would 
be constructed by him to measure his 
own individual classroom objectives 
introduced for the first time during 
the current school year. 

Articulation and Feedback Betv;een Schools 

■ Similar programs teaching the same 
performance objectives in different 
schools sometimes have different names. 
Similarly named programs in different 
schools are often quite different when 
attention is focused on performance 
objectives actually taught and evaluated. 
In other words, course names do not 
alv;ays provide a good starting place 
from which tow or more teachers can start 
comparing notes. 

Real feedback and program improvement 
will be more likely to occur v;hen course 
objectives rather than course names are 
used as the basis of comparison. In this 
way, schools could help one another. 

A typical example: Teachers of the 
same course could spell out their 
principal instructional blocks. These 
could be further subdivided into units. 
Once the contents of each unit are 
spelled out in terms of student skills, 
comparison would be much easier, 

28 



New Curricula 



Some schools will not consider 
requests to introduce new curricula 
unless these proposed curricula are 
spelled out in performance objective 
format. There are several reasons for 
this procedure. 

This makes it easier to avoid 
iinnecessary duplication. It also avoids 
ambiguity about exactly what is being 
arlr-':d to the curriculum. It enables 
members of various specialties to 
consult interdepartmentally. This in 
turn fosters an interdisciplinary 
approach. 

A typical approach: When certain 
new technology programs are spelled out 
in understandable and non- technical 
language, it is possible for existing 
departments to interface with the new 
courses in a cooperative and mutually 
beneficial fashion. If curriculum 
additions had been presented in jargon, 
such collaboration would have been less 
likely to occur. 



Course Prerequisite 



Traditionally, course prerequisites 
have been expressed in terms of courses or 
course numbers that must be taken before 
a particular course. 

It sometimes happens that students 
who habe taken -a particular course do 
not have all the specific skills needed 
.for the next course in sequence. 

To prevent this, some schools are 
spelling out prerequisites in terms of 
specific performance objectives to be met 
rather than in terms of course numbers. 

A tj^pical example: Rather than demand 
the successful completion of Typing I 
before allowing a student to take Typing 
II, it would be possible to specify in each 
local situation exactly how many words per 
minute the student must be able to type 
before being admitted to the next course 
in sequence. • 

Such a change could have numerous 
^pnercussions on the building of career 



Validation of Methodology 



Hunches and serendipity play a 
role in teaching as in every other 
area of human activity. When one tries 
to develop a scientific approach to 
determine the validity or approia teness 
of a particular method relying on one's 
inner 'feelings is not scientifically 
enough. 

One of the largest difficulties of 
validating innovative teaching methods 
is that the unforeseen results of 
instruction can sometimes outnumber the 
preplanned objectives. Such a situation 
is more like an exploratory investigation 
than a validity study. After sufficient 
brainstorming and creative discovery, the 
time comes when it is necessary to check 
out insights and intuition to verify their 
effectiveness in educational settings. 

Rigorously defined, validity means 
that a particular method or technique 
has objective evidence that links it 
with the attainment of a particular goal. 
Validity does not mean that a panacea has 
been discovered which v;orks equally well 
with a broad spectrum of objectives. 

A typical result: When objectives 
are spelled out in performance terms, the 
results of methodological analysis will 
center on finding which means work more 
effectively in attaining certain highly 
specified goals'. There will be no 
attempt to find methods which will "work" 
with any or all goals; there will be no 
attempt to find ways to "motivate" ""all 
students regardless of ability or 
personality to make progress towards vague 
general goals . : 

Similarly, when tne desired goal is 
the exploration of the unexpected, v;ays 
will be found to achieve this global 
shotgun objective v^hich has been defined. . 
Along with the goal, definite criteria 
of brainstorming such as heterogeneity of 
.response, freedom of expression, and 
attentive listening will be specified; 
no room will be left for the possibility 
of trying to measure creativity by tests 
which do not go beyond memory and recall. 



ERIC 



grams and course options since the 

ger of needless duplication is 

greatly reduced by precise terminology. 
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Budgetary Support 



Local Media Support 



Once a teaching-learning media has 
been found to improve learning, as 
measured by hard data rather than by 
teacher-pupil-salesman enthusiasm, it 
woujl.d seem likely that even the most; ' 
cost-conscious school board would 
approve appropriations that yield a 
higher .amount of learning per dollar 
in less time. 

This is a simple application of 
.the current stress on accountability. 

A typical example: Funding bodies 
are notoriously slow to approve "lump 
sums" even for the most worthy of 
goals. When teaching expenses can be 
justified in terms of "what students 
can now do as a result of instruction," 
it becomes e^isier to understand the 
consequences of approving or disapproving 
a line item on a school budget. 

It would not be inconceivable that 
the consequences of not funding a particular 
objective could be demonstrated to be even 
more expensive in terms of wasted potential 
hum.an development, 

Publishinp, Support Beyond Textbooks 

Once comniercial tex tbook-- and media 
producers are informed of what is needed, 
they will be quick to solve the media 
support needs of those performance 
objectives having the widest market appeal. 

It is anticipated that a very practical 
and simplified coding system will be 
developed to tell teachers at a glance 
what is available to make their teaching 
more effective. 

A typical example: A teacher of 
auto mechanics (A-MECH)' to students of 
average (AVER) ability who is beginning 
a unit on engine (ENG) inspection (INSPECT), 
will simply print the following on- a 
computer card: "A-MECH, AVER, ENG, 
INSPECT, LIST, PRICES." LIST tells the 
company that he wants a computer print-out 
list of available materials. PRICE tells 
the company that he wants an itemized 
price list for appropriate materials 
helpful to teach this unit. 
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The school library and the local 
audio-visual department will be helped 
by such classification systems. They 
will be able to identify literature and 
periodical needs more precisely. In 
situations where the budget is tight, 
the number of students pursuing a 
particular objective will be able to 
be taken into account- v?hen allocating 
funds for new items. 

Many -of the locally taught course 
objectives will be backed up by media 
commercially available. This v?ill leave 
the local media staff with more time and 
money to devote exclusively to meeting 
local needs. They will not have to 
duplicate areas that can be handled more 
economically by larger production teams, 

A typical example: Rather than 
spend a vast amount of time preparing 
slides and visuals for those sections 
of the agriculture course v?hich are 
taught in many other centers, the local 
media staff can concentrate on turning 
out visual aids and documentation which 
stress local demands. In the case of 
objectives which might be taught only 
in one area of a county, this could 
represent audio-visual aids and support 
for objectives that might otherwise be 
overlooked , 



Individualized Instruction 

Once the curriculum is thought out 
in terms of performance objectives and 
capabilities instead of in terms of 
courses, the high school counselor is 
in a position to allow for individual 
differences by the flexibility permitted 
after the achievement of each objective, 

A typical benefit: When such a 
redesign is complete , it ■ would be 
possible for a student to ' learn at a v 
rate that maximizes the benefits of 
instruction because it takes into 
account the learner's most effective 
style of learning. Teachers have long 
sought such approaches which deliver 
tailor-made instruction, A systems 
approach is one way to get this 
cherished goal. 
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EDUCAXXONAI; TECNOLOGY 



INDIVIDUALIZED TEACHING 



A typical misapplication of the 
concept of educational technology has 
resulted from equating technology with 
audio-visual aids. Distortions arise 
because this type of interpretation 
tends to think too much of technology as 
equipment . 

. . A more scientific concept of 
technology goes beyond the hardware 
level. In education the complement of 
hardware is not software so much as it 
is "brainware . *' Brain-power in educational 
technology goes beyond the individual 
teacher teaching alone, isolated in his 
or her classroom and unassisted with tools 
beyond textbooks and chalkboards. 

New methods, of education have to be 
backed up with new technological advances 
on a level higher than physical equipment. 
Such things as team teaching, modular 
instruction, and the open, classroom 
should be preceived as technological 
advances. This perspective goes beyond 
the gadget level. 

This step is logical once course 
goals have been spelled out in performance 
terms. When technology enters the 
performance scene, diverse roles emerge 
as a part of a system where everyone does 
his psrt and where a group of people 
fulfilling different roles work together 
for a common goal. 

Such an approach is particularly 
advantageous to the school system that 
starts functioning as a system rather 
than as autonomous units unaware of 
what the others are doing. On a broader 
scale, such a systems approach could 
.conceivably develop cooperation and 
mutually beneficial feedback betvjeen all 
the school systems in an area, in a 
state and eventually in a collection of 
neighboring states. 
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Much stress has been given to the 
individual student curriculum. Such an 
approach is based upon the simple 
acknowledgement that each individual 
student learns in a different fashion. 
One of the; -reasons such an approach to 
personalized learning has not always 
succeeded as expected has been the 
obvious fact that differences in 
individual teachers have not always 
been recognized in terms of teacher 
function , teaching load , and personal 
teaching style. In other words, all 
teachers were considered to be practically 
identical in their teaching style and 
capabilities, the only difference being 
subject matter. 

Individualized teaching is an 
attempt to recognize that teachers as 
well as students have their ov/n individual 
approaches. Some teachers are good at 
lecturing to a very large group and can 
use their semi-charismatic speaking 
ability to present basic subject matter. 
Other teachers function effectively only 
in small groups where their personal 
contact enables them to achieve many 
v;orthv?hile educational goals. Other 
teachers v?ho have not been particularly 
effective in the instructional aspect of 
teaching have developed great competencies 
in such things as test construction and 
grading. 

Once in a while, one meets a teacher 
who combines all three of these above roles 
and abilities in one person. This is rare 
in spite of the fact that the typical 
classroom sometimes seems to be based upon 
the assumption that all teachers can 
function equally well in all three of the 
above roles. 

Individualized teaching simply means 
that differences between teachers are 
recognized when a teacher is assigned. 
Much more than subject matter must be 
considered in such a way that teachers 
are assigned to tasks according to their 
professional skills and accomplishments. 
A clear statement of course goals in 
performance terms will go a long way 
towards ascertaining the teaching styles 
of individual teachers. 



CAREER GOALS : A Self -Initiated 
^ Individual 
Choice 

That Usually Takes Time 



It is almost a commonplace lihat students educated in 
a particular career often find employment in an entirely different 
career. This has led to two approaches to bridge this gap between 
training and entry job. One approach tries to stress career families 
and clusters. The other tries to stress self-initiated activities 
and goals for students within the existing occupational programs. 

There is much to be said for teacher-imposed objectives in 
skill areas . * There is much to be said for self-initiated activities 
to motivate students to learn up to Their full emotional and human 
potential. Career goals are often cl^^rified in an atmosphere which 
equally emphasizes personal choice ami skill acquisition. Any 
system of performance objectives must take account of objectives 
that originate from students as well as from teachers. 



PERSPECTIVE: Possible Distiortiion of Performance Objectiives 
and Suggestilons on How _to Use These Objectiives Properly 



Wlien an educator star lis asking two questions, 

9 "Why should I write performance objectives?" and 

o "Why don't the* objectives I write work as V7ell as- 
I expect?", 

consideration as to the use and misuse of performance and behavioral objectives has 
bei^un. 
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The format used below to answer these questions is divided into two columns: 

(1) the possible distortions that can arise from a misinterpretation 
of the nature of performance or behavioral objectives, and 

(2) the corrective perspective necessary to remedy these misapplications. 

Each of these sections is based upon practical difficulties encountered when 
individual teachers started to write and systematize performance objectives. 



1* Behavior 



vSince "^bchavior here itieans observable 
results of learning, it is possible to 
fall into the trap of measuring oaly 
easily evaluated performance. 



Advocates of cr i ter ioa-ref erenced 
objectives recognize that not all 
long-term affective and cognitive goals 
can be easily- measured objectively. 

This still leaves open the possibility 
of improving evaluative instruments by 
explicitly employing concrete language to 
state what is meant by a particular goal. 

All this goes back to the definition 
of a performance ob j ec tive -which is a 
statement of an education goal which tries 
to answer three questions: 

Exactly what is it that one wants 
students to do or perform or 
achieve as an instructional outcome 

0 What materials and what procedures 
will best help the student to 
attain this chosen objective? 



What criteria will reveal when 
students are performing 
successfully? 
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Possible Distortions 



Corre c tlve Perspective 



2. More Meaningful 

Statement of Goals 



Performance objectives strive to 
e'xpress in clear and uncomplicated language 
the desired outcome of an educational 
proces s . 

Sometimes* this is done in a fashion 
that discourages exploration of a variety 
of ways to achieve this specified result. 

Sometimes, this is d-^ne In a way 
that forgets that certain nethods are 
simply not acceptable socially or 
economically. 



Such things as sample teaching 
procedures and sample test items are 
merely offered as examples of how to 
achieve a goal and how to know when one 
has achieved it . Tliey are lllus tratlve 
examples of goals and typical criteria; 
they are not ukaseSo 

Goals should be specified. Once a 
teacher's goals are known, he can be 
judged solely on the success he has in 
achieving^, clearly spelled out objectives 
Questions of philosophy, methods, and 
personality are seldom as observable 
as the results of good solid instruction 

It must be retnetubered that merely 
stating a vague objective in performance 
objective terms does not do away V7ith 
the necessity to make philosophical 
judgments or reasonable cost analyses. 



Limited Horizons 



Once a goal Is . learly thought out, 
whether it stresses minimum or maximum 
performance, it is possible to take it 
as the only norm of excellence. Other 
worthwhile but unwritten goals could 
be overlooked or neglected. 

In an atmosphere that would stress 
competition and cost-cutting more than 
unlimited human development, it is 
possible to develop the attitude that 
supplementary and less visible goals 
xan be safely overlooked since they 
are not as clearly observable as other 
more basic goals. 
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Properly understood, the function 
of performance objectives Is to stress 
the main measurable goals of an 
educational program. ' Once these basic 
goals are attained, students will be 
properly prepared- to go on to other 
worthy goals that could be of a less 
tangible nature. 

The most visible goals of a program 
■^.^ do not^ always^ cotl'tain all desired 
* ;;eduiaatlonal results « To think so would 
^be ^feo pretend that placing a match under 
"^^a room thermostat is equivalent to 
"^providing adequate temperature control. 

In weight control , the scale is an 
objective measure of loss or gain, but 
it overlooks the valuable areas of 
nutrition and balanced diet. The goal 
of personal development is difficult to 
measure. This does not meant that it 
should be overlooked. 



Pos*sible Disc or t: 3,0ns 



Corrective Perspective 



4 . Time-Consuming 



Actual data checks of writers of 
performance objectives in local 
educational agencies reveal that some 
teachers have spent more time writing 
objectives than actually teaching them 

Their time and efforts could be 
spent for more practical educational 
activities , 



This suggestion,^ laudable as it may 
be from a research point of view, misses 
the point behind performance objectives. 

Translating a .curriculum into 
performance objectives is- not so much 
a construction process as a selection 
process , 

Once a bank of objectives is 
constructed, the teacher V7ill be able 
to select appropriate objectives and 
to write from scratch' those needed for 
local curriculum adaptations. 

Even before this bank is available, 
a function of the teacher is to select 
what is most important among the terminal 
behaviors or. performances he wants his 
students to possess. He is not expected 
to spend most of his time writing. 



5. Duplication of 
Effort 



It is conceivable that teachers in 
separate schools will spend much time 
writing the very same objectives in the 
same format. 

If this process is repeated over 
and over again, needless duplication 
r-e suits . 
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Duplication can be prevented by 
the nature of the feedback built into 
a computerized system: 

o feedback of the instructor's 
course objectives codified and 
classified 

o feedback of related course 
objectives from other 
instructors and other schools 
similarly referenced 

o feedback of objectives from 
courses with similar names, 
similar students, similar grade 
levels, and other helpful 
variables . 

After a teacher has chosen objectives 
that have been codified into the system, 
it will be possible to retrieve teaching 
materials and testing items developed 
by other teachers teaching the same or 
similar objectives. This look at what 
otfciers are doing should foster a fresh 
apprpach to teaching. 



Possible Distortions 



Corrective Perspective 



6, Centralization 



It is easy to imagine, a teacher 
becoming intimidated by what the majority 
Gf confreres are doing in the same areas. 

This could lead unvjittingly to a 
centralization more penetrating and more 
rigid than any ever achieved by 
administrative fiats. 



Such abuse is always possible* On 
the other hand, much wasted effort results 
when a good teaching approach or test 
item developed by one teacher goes 
unpublicized and unused by other teachers. 

Practical classroom discoveries are 
quite specific and often on a low level 
of generality. , It happens that, unless 
such methods are tied to a specific 
objective, what works for one teacher 
will not work for another who has 
slightly different goals in mind. 

With a centralized classification 
system, it is possible to pinpoint what 
works and what doesn't work to achieve 
a highly particularized objective. 
Teachers can share good ideas with one 
another even when they cannot always 
generalize to other goals. 



7, Paperwork and 
Window-Dressing 



Once a person has an answer to a 
previously unanswerable problem, it is 
possible to take the result of his 
challenging encounter and turn it into 
a teclmique that can be e.asily imitated 
even by people who don't understand it. 
This is how misapplications occur. 

Simply ^ re-writing objectives in 
performance objective terminology is 
not the same as re-thinking exactly 
what it is that one wishes to teach. 



By filling in the numbers, it is 
possible for someone with no art training 
to reproduce the Mona Lisa. This example 
make it easy to see that there is often 
more to art education than merely the 
finished product. 

A properly constructed curriculum 
expressed in performance objective terms 
can enable an instructor to benefit from 
many advantages: 

o clarification of his goals 
and hov; he can evaluate them 

o examination of the values 
upon which he chose present 
course objectives 

. e presentation of goals to 

students in a form "tTiey can 
more readily understand 
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Possible Distortions 



Corrective Perspective 



8. Too Much Detail and 
Not Enough Decision 



In spelling out the desired 
outcomes of instruction, it is easy 
to get overly concerned v;ith details 
"and to forget essentials. 

It is easy to get into a routine 
that stresses only those things which 
demand immediate attention such as 
tests and report cards \<?hile forgetting 
other more important things such as 
lesson planning and student, motivation. 



. No system is perfect. Every approach 
can become outdated and perfunctory. 

A system of performance objectives 
can contribute to the elimination of 
unnecessary teacher activity: 

o Identical objectives that appear 
in tV7o or more courses can be 
eliminated; this ^■i'ill demand a 
decision upon v?here the goal is 
more appropriate 

o The construction of examinations, 
v?hether on a unit or on a terminal 
level, will be simplified; instead 
of writing all the test questions, 
the teacher will decide which of 
the available test items best 
measure exactly what he is trying 
to get across in his teaching 

0 When students learn of course 
goals in terms students can 
visualize, they v;ill be able to 
realize how the objectives 
chosen by their teacher actually 
meet their needs. 



9. Too Much Classification 



For effective retrieval and usage, 
performance objectives put into a 
computer require systematic codification 
and classification. 

For the busy teacher or administrator 
who is thinking only in terms of local 
needs, much of this can seem like a 
waste of time. 



Basically, any taxonomy class^ifTcatioii 
has both a theoretical and a practical 
value for educators. 

Theoretically, it places a particular^ 
objective in perspective and helps to 
anticipate difficulties which might arise 
when an idea is put into practice. . 

Practically, classification systems 
serve many purposes. Complex classifica- 
tions based upon prerequisite physical . 
skills and coordination necessary for a 
particular job require much time. This . 
coding task makes more sense when one 
realizes how invaluable this would be 
in occupational counseling for the 
handicapped , 



Possible Distortions 



Corrective Perspective 



10. Bad Fits 



Classification codes will make it 
easier to get a better fit. 



Correlated readings, visual aids, 
teaching manuals, and test questions ^l^, 
have been around for a long time. 
However, the average teacher who tries 
to use them in his course sometimes 
finds that a film or a visual aid is 
unsuitable for him or for his students 
even though it worked for another 
teacher. 

This does not mean that the film 
is useless or that one teacher is right 
and the other is wrong. It does indicate 
that both teachers have similar general 
objectives which are quite different 
when one gets down to specifics. 



11. Educational Technology 



It's a lot like buying a shirt^^ 
Instead of specifying a large collar 
with very long sleeves, this system 
would offer more precise choices and 
combinations: e.g. collar size, 14, 
15, 16, 17, or 18, with a choice of 
sleeves from 33^ 34^ 35, or maybe 36. 
Not all students are the same , but 
conceivably most students would get 
the same style shirt in his own 
individual size combination. This 
is a close analogy to the individuali- 
zation available from performance 
objectives. 

To work, a classification system 
must zero in on a general area. It 
must also be codified in a v;ay that 
v;ill correlate with differences in 
teaching approaches, learning 
and local circumstances. A strictly 
general classification would probably 
not be specific enough for effective 
individual applications. 



Many teachers succeed with large 
group instruction. They give well 
prepared lectures that challenge and 
inform the student audience. 

When such teachers start to think 
in terms of performance objectives, 
they find that such considerations as 
audio-visual aids, test items, 
observable behavior, and criterion- 
reference instruction are much too 
technical for them. These aren't - 
their fields of expertise. 

When the computer enters the 
classroom scene, these teachers ask 
themselves the identity question: 
"Am I a teacher or an engineer?'^ 

o _ Si) 



This is a quite natural situation. 
It opens^'the door for drastic innovation 
in the classroom. Rather than expecting 
the teacher to be a jack-of -all-trades , 
an integrated system involving performance 
objectives will require a team approach. 

Common senses and logic makes, it 
obvious that certain teachers excel in 
one or more teaching activities. r"^milarly 
paraprofessional. s-taff members are also 
a valuable part of the teaching-learning 
team, 

A teacher who can do nothing but 
lecture will not be left off the team. 
Such a teacher will have even more time 
to prepare intellectually stimulating 
lectures since someone else will take 
care of tests, grades, and technology. 



Possible Distortions 



Corrective Perspective 



12 » Accountability 



Teachers have fought for quality 
instruction regardless of its cost. 

Once a cost-analysis is performed 
yith the aid of performance objectives, 
it is easy to imagine situations where 
economy and not effectiveness becomes 
the dominant consideration. 



Cosu is one easily identifiable 
factor in the variables of accountability. 

Accountability goes into'' otlier areas: 
colleague evaluation, shared decisions, 
more effective use of a teacher's 
individual talents and v;orking hours, and 
more diverse definitions of what it means 
to be a "teacher.'^ 

The emphasis in accountability goes 

beyond cost. It asks the question, ^'Who 

is respons;;i:bl^ for these results or lack 
of results?'^ 

This is imniediately followed by 

another question: "What can be done to 

improve the situation?" The answer to 

this question can result in performance 
objectives. 



13. " Academic Freedom 



Teachers have traditionally demanded 
the liberty to express their academically 
honest viewpoints based upon solid 
intellectual scholarship. 

It is conceivable that once 
performance objectives become a 
dominant factor in the curriculum , 
that this form of teacher pov;er v?ill 
be subject to a number of pressures 
that will militate against controversial 
or innovative individuals engaged in 
teaching. 



Academic freedom is not attacked 
by performance objectives. Asking a 
teacher to present his objectives in 
performance objective terms is not the 
same as telling an individual teacher 
that he is not allowed to present a 
certain intellectual position. 

Performance objectives are intended 
to make a teacher intellectually more 
honest by making his goals intellectually 
more understandable. An expert in 
performance objectives avoids saying he 
is trying to "eschew verbal prolixity 
and obfuscation, " Re will say he is 
"trying to avoid vague and- unclear words 
not understood by the man in the street.'* 

Performance objectives force a 
teacher to distinguish clearly between 
presenting a personal viewpoint and 
proselytizing. 
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Possible Distortions 



Corrective Perspective 



14. Autonomy 



When goals are spelled out in 
everyday language, it is obvious that 
they will be understood by a broad 
spectrum of people. Many of these 
will not be experts in a particular 
domain. 

People feel free to criticize 
what they think they understand. It 
is conceivable that many non-specialists 
will start looking over the shoulder 
of the specialist with suggestions and 
retommendat ions . 

This could begin to resemble the 
situation where ''too many cooks spoil 
the broth." 



Performance objectives do not destroy 
the autonomy of an educator. They make 
him begin thinking of hov; tp JLntegra te his 
goals and efforts into the mainstream of 
society. Society will not necessarily 
force him to change his objectives, but 
it does demand that he clearly label 
them. 

' This will probably become a reality 
once objectives are stripped of a semi- 
mystical language . 

In the very practical matter of 
program budgeting, programs which are 
clearly stated and which make sense to 
a practical minded though hard-nosed 
individual will have nothing to fear.. 



15. Success 



With a traditional formulation of 
goals, even the most severe evaluation 
will not condemns project because it 
was not as successful as anticipated. 

A program which may appear to be 
unsuccessful can be esteemed in the eyes 
of the academic community. An example 
would be a successfully reviewed play 
which becomes a financial "flop." 

With the introduction of easily 
observable performance objectives, it 
is quite simple for the ordinary man 
to make his evaluation v7ithout any 
need for scholarly credentials. It 
can be asked whether or not this will 
take evaluation out of the hands of the 
experts and place it in the hands of 
the man on the street. 



Even the best educational program 
'Will not achieve all of its concisely 
stated performance objectives. If none 
of them were achieved, this does not 
mean that the program is no good and has 
to be abandoned. It does mean that 
success or failure goes.-beyond what can 
be specifically defined. 

If success has been attained, more 
all inclusive goals can then be proposed. 

If a certain amount of failure is 
present, the conclusion should be "These 
particulars must be improved" and not 
"The entire program is v7orthless." It 
might be a refreshing change of 
atmosphere to have projects that needed 
other remedies rather than "more money," 

The man in the street who pays 
taxes should understand where his tax 
dollar goes. This might make him less 
reluctant to approve budget increases. 
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Possible Distortions 



16. Tenure 



Teacher performance can be thought 
of in terms of student performance and 
achievement rather than in terms of 
"degrees and faculty tenure. It is 
conceivable to think of situations 
wherein such traditional academic 
yardsticks will baconie less prominent 
in teacher assessment. 

This could have repercussions on 
faculties and schools alike. 

It is easy to think of situations 
\^herein an untenured teacher might 
outperform a tenured faculty member. 
Then the question would arise: "Who 
should be department chairman or 
supervisor?" 



Corrective Perspective 



Performance objectives are more 
than a measurement of whom to retain or 
to dismiss among the teaching staff, 

A good teacher would not have to 
worry about unfounded criticism or 
about gaining or losing favor since he 
would have objective evidence in 
establishing the fact that his class- 
room performance is up to or above 
minimum standards. 

An ineffective teacher would "not 
necessarily be fired because he was 
<below acceptable standards in two or 
three performance areas. Rather than 
receive a vague unsatisf actory^ ra t ing, 
he would be told of specific needed 
improvements. He could then be 
retrained in clearly defined areas. 



17. Intangibles: 

Vague but Valuable Goals 



An educator open to a humanistic 
value system vjill often find himself 
short of adequate descriptors when it 
comes to putting his goals down on 
paper. 

It's not that his goals are unreal 
and ethereal. It's rather a question of 
certain ideals that cannot always be 
adeuqately captured in scientific prose. 
There is also a certain amount of 
subjectivity that legitimately deserves 
a place in education even though it 
cannto be counted, measured, and 
parceled out in neat and precise 
formulas . 

Such an educator would seem in a 
precarious position if only highly 
visible and measurable ^gb'als were in 
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It is not the purpose of perfoniiance 
objectives to de-humanize education. 

The purpose of performance objectives 
is to render an educator^ s objectives 
understandable to a broader spectrum of 
humanity some of whom are more or less 
talented in abstract verbalization. 

Any educator with vague but valuable 
objectives will find himself challenged 
in the necessary process of interpreting 
his objectives to his audience. 

Many a teacher sincerely believes 
his goals are on the understanding and 
value levels. At the same time, he uses 
memory questions as his only measurement 
criteria for. such mundane things as 
grades. He needs help to admit and to 
remedy this discrepancy. 

He can be helped to search out 
valid measures of high level cognitive 
and affective changes which are not usua 
measured by multiple choice test items. 
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Corrective Perspective 



18. Minimum Vision 

One of the advantages of a 
performance objective is that it 
Sets up a minimum achievement that 

-can be achieved step-by step. 

■■ * 

One of the disadvantages of 
setting up a minimum is that by 
routine and inertia, it can become 
the accepted norm of excellence. 
Once the minimum has. been att'ained, 
it is easier to stop striving and to 
be content v;it:h doing nothing more. 

Both fee the teacher and for 
the student, this V7ould be a sad 
state of affairs. It v^ould limit 
the gifted to the same level of 
performance as the average or 
below-average. 



19. Contracts 



Minimum performance objectives are 
not the only criteria of success or 
achievement. After one's hunger is 
assuaged, there is always plenty of 
room for dessert. Success does not 

exclude further success . 

u — < 

The concept of a performance 
objective on an elementar}^ level does 
convey the idea that even the^most 
severly disadvantaged, handicapped, or 
unskilled trainee or student can do 
something. They are not doomed to 
mediocrity simply because they are 
not on the gifted level. 

The job of the teacher is to 
challenge his students without dis- 
couraging or coddling them. If he 
finds that a particular student has 
achieved the bare minimum with little 
or no effort, then the job of the 
professional teacher is to provide 
goals and motivation that will 
stimulate the student or trainee 
to greater accomplishments. 



Signing a teaching contract 
involves several steps. A teacher 
applies for a job. The local educa- 
tional agency sits down and evaluates 
his credentials and experience. If 
the teacher is deemed qualified,, he 
is hired. The administration places 
' its confidence in him and gives him 
a teaching assignment. After that, 
he is presumed capable of deciding 
v;hat and how he will teach. 

Performance objectives seem to 
set up different priorities. There is. 
- a wider area of decision making. Such 
things as detailed curricula, test items, 
and crite?:ia of success are often themselves 
.the subject of negotiations. VJith all 
these legalities, it would seem that a 
certain amount of legal training would 
come to be considered more valuable than 
pedagogical" skills. 
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As real as this objection is, it 
probably applies mo.re to performance 
contracting than to performance objectives. 

It does point out that the two areas 
are related. Before an educator can 
begin to guarantee results from his 
teaching, it is necessary to spell out 
these results in terms that can be 
understood by all' part ies concerned . 

When. a person buys a product in a 
store, he wants a certain guarantee that . 
it will do what it claims. 

Certainly, a similar situation exists 
in education. People want to have some 
guarantee that the school will deliver 
as it p romises . 

Performance objectives simply spell 
out what the teacher is trying to do. 
Once this is clear, other educational 
questions can be broug-ht out in the open. 



Possible Distortions 



Corrective Perspective 



20. Working Hours 



Working hours, the nine to five 
flay ,seem to be part of society. The 
school is no exception. There are clearly 
stated times of attendance and vacation: 
®ne for learning, the other for resting* 

With performance objectives, all 
this could possibly change. 



There is much truth in this objection. 
This same social phenomenon is happening 
outside the school as can be seen from 
the emerging concept of the 4-day week. 

Schooling is thought of in terms 
of what one h.^is learned rather than in 
terms of what one has done in order to 
learn. It is possible that individual 
teachers and students v?ill find that 
they function better outside of the 
traditional school and timetable. 

This is not.the point in question. 
Performance objectives are concerned 
with the task one is trying to do, not 
with the methods individaully chosen to 
achieve these goals. In this way, 
education will be seen as an adventure 
and not as a confinement inside a 
school builditig for a certain amount 
o*f time each day. 

The traditional way of keeping 
track of school attendance is less 
important than what is learned. 



21, Examinations 



There do exist certain systems of 
education where the criteria of success is 
defined as successful examination-taking. 

In such situations, the students 
realize that their academic credentials 
are concerned only with grades on a 
final exam, whether written or oral. 
Such systems have been in force for a 
number of years. As a matter of facet, 
the disadvantages of such a method have 
inspired many of the features of modern 
classroom instruction as they exist in 
the United States. 

Students are ordinarily taught 
nowadays that there are many other 
things that are important to an 
educated person even though they 
don't appear on the final exam« 
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The entire issue of the educational 
worth of examinations is a complex problem.' 
It is rendered even more complicated vjhen 
one recalls that the results of examination 
are attached to such units as Stenography 
I, Business II, or Auto Mechanics lllo 

Each descriptor falls far short of 
defining definite subject matter 
competencies or specific marketable 
entry level skills . 

Performance objectives do not offer 
a panacea for this problem, but they do 
try to develop descriptors that tell 
precisely what a person will be able to 
do as a result of passing a particular 
examination item. 

It is a lot easier to verify ' 
something a person can see than to - 
speculate whether or not a person 
knows or understands something. 



V 



Finding Out 

What Other Educators 

Are Doing 



ERIC 



If) 



\ 



THE FIRST STEP : How to Start Writing 

Performance Ob j ect ives 



\ 

Whether or not there are a large number of teachers who 
have started writing performance objectives for their students is 
a question open to discussion. 

Once one defines a performance objective as a formulation 
of an educational goal spelt out in terms of measurable performance 
as its criterion, it is obvious that thousands of teachers have done 
the necessary thinking and deciding to develop criterion-reference 
goals for their classroom activities. 

Because much of this work has occurred without feedback 
from other teachers in similar courses, a great amount of educational 
planning has been done over and over again in a way that resembles the 
repetitious activities of Sisyphus. 
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The Working Force for This Project 



At the present time, there are thousands 
of teachers who are spending long hours 
preparing their classes. 

Whether these teachers realize it or not, 
all the V7ork they do to develop interesting 
lesson plans, well thought out test questions, 
£rnd practical teaching aids are really part 
of performance objectives. 

They have done enough V7ork to provide a 
sound basis for educational innovations. Only 
one thing is missing: they have not provided 
a method of recording, classifying, and 
evaluating all their V7ork. 

Because this v;ork is repeated over and 
over again without feedback, it is much like 
a book misplaced in the librar}^. For all 
practical purposes, it is lost. 



The First Step - Write Only One Objective 



In order to get teachers to start writing 
performance objectives, it is absolutely 
essential that they do not V7rite too much. 

The important thing is not to V7rite 
'hundreds of objectives for a particular 
course, but to write one or tv7o carefully 
chosen objectives that stress principal goals 
of a particular teacher for a particular 
group of students. 

It would be better for-^^a" te 
voluntarily to write in half an hour one 
performance objective which is clearly 
understandable than under duress to write 
hundreds of performance objectives which are 
more paperwork than practical teaching and 
learning guides; besides, all this needless 
-writing would take too much time. 



The format eventually chosen should 
reflect tv7o things : 

© local needs 

© compatability with a feedback syst( 

Then Pass It Around for Comment 

Once an objective has been written, i1 
v7ould be given to colleagues and to studenl 

Any difficulty they might experience 
understanding precisely what he meant woul< 
force the teacher to get rid of vague wordi 
such as "know" and "understand." This rigl 
critical audience would force the teacher 
express his objectives in concrete terms. 

For example, if he knew he was going 
rely on fill-in questions as his sole 
evaluative criteria, he would have to say 
that his observable and measurable goal V7as 
"the ability to recall from memory V7ell 
enough to answer fill-in questions" insteac 
of saying that he vjanted his students "to 
really know" his subject matter. 

Another example: JLt he claimed highei 
goals such as "creati^ty" or "deeper 
understanding," he WQ|[tld be forced to ask 
himself, "How am I gaffing to measure these 
outcomes which, cannot be ascertained from 
s trictly recall ques t ions ?" 

All of this would have to take place 
before the course began and not just before 
the final exam. 



An Aid to Evaluation 



Format 



Sooner or later, a group of teachers V7ill 
want to develop a uniform format on which to 
record and write performance objectives. A 
later section gives one of many possible formats. 



A teacher is asked to write merely one 
performance objective, not to give him more 
paperwork, but to get him to ask concrete 
questions about exactly what he is expectin 
of himself and of his students in the 
classroom. 
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^Dnce a teacher puts his objectives in 
terms that can be recognized by the average 
man on the street, he x^?ill find out two 
things: 

o he will get suggestion after 
suggestion on how to improve 
either his goals or his methods 
or his evaluation techniques, and 

* o he will begin coming up with many 
improvements himself. 

It's similar to a situation wherein one 
starts competing with oneself, it's hard to 
remain satisfied even with above average 
results . 

This seems to be the motivation in golf 
where both pro and amateur keep getting better 
or worse because there is a very visible 
method of keeping score. 

The Second Step - Correlate One Test Item 
with a_ Well Written Objective 

Once a teacher has written one performance 
objective, he will know the difference betvjeen 
vague and precise terminology. 

The next step vjould be for the teacher 
to take the best test question off his last 
examination and try to identify which 
objective is being measured by this test item. 

After this has been done, he vjould ask 
his colleagues and -students to tell him 
whether or not this item is measuring 
understanding or merely memory recall. 

Professional Growth 

It is a revealing experience for a 
teacher to struggle with the uncertainty that 
arise from a few simple questions: 

o ^'Which course objective does this 
test item really measure?" or 

o "How does one construct a way to 
measure the creative goals of this 
course?" 

O 



After a few hours alone with these 
questions, the teacher will realize that 
he needs feedback; he needs to know what : 
other teachers of the same and similar 
courses are doing. 

He will then be in a position to leari 
from them their secrets of success to shar( 
with them vjhat he has learned from persona! 
experience. 



The Th.^rd Step - Start to Rate and Classif; 
Object ives 

Once the teacher understands the conci 
terminology of performance objectives and 
how to relate them to test questions, he 
is ready to start choosing the most importi 
objectives of his course. 

These objectives need not necessarily^ 
be perfectly v;ritten and unalterable. 

Even if imperfect, these objectives v;: 
allow the teacher to make comparisons and 
revisions. 

Once his objectives are codified by 
subject matter, he will be able to compare; 
his objectives with those of other teacherj 
of the same material. 



The Fourth Step - Tie Objectives and Tests 
and Media Together into £ System 

Once he starts getting feedback from 
other teachers about their objectives, he 
will be able to use tools they ha^ve found 
successful. This would include: 

o test items , 

o evaluation instruments, 

o instructional media, 

0 other techniques. 
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The Fifth Step - Start: Using the Performance 
^Objective Code Number 

In the same manner, once a subject matter 
is divided into a carefully codified set of 
objectives, the teacher is able to apply the 
same code numbers to teaching aids and other 
educational braim^jare and hardware. 

Thus, when the teacher has chosen a 
particular objective for his students, he 
'will be able to obtain a number of helpful 
teaching tools : 

© teaching aids , 

o classroom projects, 

o les son plans , 

o classroom activities, 

o supplementary reading, " ' 

o testing, and 

o evaluation instructions by means 
of one code number. 

In the same way, with the same code number 
the student will be able to obtain similar 
learning 

G individual assignments according to 
his ability "and interest, 

o projects developed especially 
for him, 

o study. guides designed with his 
ability and interest, 

o projects developed especially for 
him, 

o study guides designed with his 
abilities and strengths in mind, 

Q extra tutoring when and where it 
is necessary, and 

o a profile of his marketable skills 
which achievement of a particular 
objective will give him. 



The Sixth Step - Ongoing Activities 

This section has stressed only a 
general overview of the first steps necessa 
to start writing performance objectives in 
a systematic way. 

It takes a lot of time and work to mal< 
these initial extra efforts for the benefit 
of a system. The next section on the 
benefits of a carefully developed system 
will show a few of the long-range advantage 
of this extra care when a teacher begins 
writing. 
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REPORTING FORMAT : The Question With 

Many Poss ible Answers 
and Approximations 

After all the theorizing and deciding is done in a 
school or in a department about to start writing performance objectives, 
one common question arises, "What uniform format will satisfy all of 
our needs?" 

Typically >these needs include various possible uses to 
which the objectives will be put : ease of writing, possibility of 
editing, reproduction either by copy machines or by computer print-out, 
coding for retrieval and cross-reference purposes, ability to be used 
for developing a tally and picture of the structure of what is actually 
taught in a particular area, built-in research and evaluation potentials, 

i 

and demands of both teachers and students. 

This makes a lot of decision necessary even before the first 
objectives is ready for writing or entry into the system. 
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DISPLAY 



Form //9. 



EVALUATION SERVICE CENTER 
FOR OCCUPATIONAL EDUCATION 

Behavioral Objective Roportinq Form 



Cqde No. 



Field of Study 

Major Group ^ 

Sub Group 

Block ^ 

Unit 



I nstruct iona I Time 



No, 



State ^ 
Schoo I 



I nstructor 



Faci I i tator 
Leve I 



No. Taking Obj • 
Schoo i Year IVr i tten 



Behav 1 ora I Object i ve 



Condition(s) 



Per forma nee 



Extent 



Direct Prerequisite Unit(s) 

Direct Dependent Unit(s) ______ 

Exit Behavior (Check One) Yes C ] No [ ] 



All These Forms Begin to Look Alike 



After reviewing a typical behavioral 
or performance objective reporting from, 
one can begin to think, "They^re all 
pretty much alike^" 

Closer examination will show that 
this is true as far as conditions, 
performance, and extent are concerned. 
However, even such common elements as 
subject matter code show many possible 
variations both in code and in theory 
behind the code. 



Don^ t Get Tied to Non - Essential Details 

Form #9 is presented merely as an 
example of who't one evaluation service 
center has done.. 

Each of the entries on this form was 
no doubt the subject of serious and 
prolonged discussion. 

Going through the information it 
codifies will serve as a good introduction 
to the basic requirements of the typical 
reporting form. 

An Item by Item Analy sis 



Code No. 

This is a summary in numeric form of the 
following information whidi specified a 
^number of things about the objective: field 
of stud}^, major group, sub-greup, block, 
unit, sub-unit number, instructional time, 
direct prerequisites, direct dependent units, 
exit behavior potential, capability 
classification, and related disciplines; 
also in the local writing domain: state, 
school instructor, facilitator, level, number 
taking objective, and school year written. 



Field of Study 
Major Group 
Sub ' -Group 



These refer to the first six digits 
of the USOK subject matter code. 

Example: r/.OOOO indicates the 
field of study (traded and industry). 

17. 0300 indicates the major group 
(automotive industries). 

17. 0302 indicates the sub-group 
(mechanics). 

Block 

Unit 

Number 

These refer to the 7th, 8th, 9th, 10th,; 
11th, and 12th digits added to the basic 
USOE code for subject matter. 

Example: 17.03020^00 could refer to 
engine; 17.03020600 could refer to brakes; 
17.03020800 could refer' to chassis. 

Thus, each sub-'group would be broken 
down into blocks (7th and 8th digits). 

Similarly, each block would be broken 
down into units (9th and 10th digits). 

Example: 17.03020406 could refer to 
six-cylinder engines; 17,03020408 could 
refer to eight-cylinder engines. 

When necessary, further sub-divisions 
would be possible through the use of other 
numbers (11th and 12th digits). 

local reasons for a particular 
iUmber must be kept in mind to avoid 
wo extremes of too general or too 
minu*:e a classification of course goals. 




CAPABILITY CLASSIFICATION 



Psychomotor 

[ ] Psychomotor (Check only if oerformance requires a significant amount 
of muscular activity). 

Cognitive 

(Checi's the one cognitive capability that- best describee the mental 
act i V } ty i nvo I ved ) , 

Knowledge AcquisiTion 

CD CI. I Knowledge of Specifics 

CD CI. 2 ^Know,l,edge_of Ways & Means of Dealing with Specifics 
Knowledge Application 

[ D C2.! Knowledge AppI i cat ion V/ith out Alteration 
C D C2.2 Knowledge Application With Alteration 

Related Subject Discipli n e (Check those applicable ) 
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C ] 



C ] 
C ] 
C J 



[ ] 

C ] 
C ] 

[ ] 
[ ] 

C ] 
C ] 
C ] 

[ ] 
[ ] 



C ] 

[ .1 



M ATH[IM/\TICS 

Elemohtary School Mat[iematics 

Basic arithmetic & operations-^ 
1 n forma I a I gebra 
Informal geometry- 

Mathem atics (7th & 8t h gr^ides ) 

App 1 i ed ar i thmet i c 

Geometry & measurement 

Algebra^ graphs, problem solving 

Secondary School Mathematics 

Algebra (f i rsi* year) 
Algebra (second year) 
A I gebra ' (th i rd year) 
Geomeiry 
Tr I gonometry 
Business Arithmetic 
Consumer Mathematics 
Sliop Mai hemat i cs 
Ca I cu I us 

Computer Mathematics 

OTHER 
(Sped fy ) 



SCIENCE 

[ H General Science 

Bio log y 

C Genera 1 Bio logy 

C H Anatomy 

C H Bacteriology 

C H Biochemistry 

C H Ecology 

C H • Nutrii ion 

C ] Physio logy 

Chemi stry 

C H General Chemistry 

C H Inorganic Chemistry 

C H Qualitative Analysis 

CD Quantitative Analysis 

£ H Materials Science 

Physics 

C H Genera I Phys i cs 

[ H Electricity & Magnetism 

C H E I ectron 1 cs 

[ ] Heat 

C H Mechan i cs 

[ H Nuclear Science 

[ 3 Optics 

[ ] Sol Id State Physics 

C [] Sound 
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state 
School 
Instructor 
Facilitator 

This information helps identify the 
source of the objectives (state, school 
-which would , include school district in its 
code, instructor who wrote, and facilitator 
who did the first editing). 

Level 

This code tries to answer a few simple 
questions : 

o VJhat' is the level of the program? 

o pre-vocat ional 
o secondary 
o post-secondary 
e other 

o How many years long is the program? 

o At which year in the pragraixi is 
this objective offered? 

Number Seekin g Objective 

This code tries to estimate how many 
students will be exposed to this objective 
from two viewpoints: 

o How many students arc enrolled 
in the course? 

9 How many students will probably 
be exposed to this objective?. 
This latter case will be only 
an estimate in situations where 
production (number of jobs 
entering the school shop) is 
a prime consideration. 

School Year Written 

This information will be used for 
output concerning popularity and longevity 
^-f a particular objective^ 
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.The Heart of the Objective 



Conditions 

The circumstances under V7hich the 
students are expected to perform constitute 
the conditions of an objective^ 

Conditions are expected to clarify 
such specifics as: 

e Do students have access to standard 
tables and texts or to memory only? 

o What tools must be used: 

© Will trainees be tested under 

school quiet or industrial stress? 

Each of these conditions obviously 
makes its own special demands upon the 
objective to be performed. 

Performance 

Performance means doing. The 
performance of an objective is what the 
student is expected to do. 

© This performance must be 
measurable. 

0 One of the best ways to assure 
measurability is to insist on 
a observable and easi.ly visible 
performance. 

© That is why such indirectly 

observable activities as "know, 
understand and comprehend" 
should be replaced with more 
visible verbs such as "change, 
repair, adjust, cut out and 
assemble." '• ; 

Extent 

The minimum acceptable standard of 
achievement constitutes the extent or 
level of performance. 

There will be an anticipated differenc 
between the functioning of a master mechani 
and the best student after a one-year cours 

Certain jobs will require stress on a 
number of factors including quality, errors 
tolerance, percentages, and time. All of : 
these must be spelled out as the criteria ; 
on which the performance will be judged 
successful or unsuccessful. 



\ 



SEQUibiCLJiQ " 


YR. 


T 


N 


C 


STATE 


CITY - SCHOOL 


J.VL 


kilAliO 


5UBJ. DISCIP 


CAP. CL 


NC 


5. T 












1 

































































fL 


GR 


SG 


BL 


UN 


OB 


EX 


TIME 


PR 


;REQUISITE UNIT 


S) 


DEPENOE 


NT UNIT 


(S) 






















































1 























►41 
Wl 
«| 
<\ 

Ol 
M| 

Q| 

o! 

<l 
col 

Hi 

oi 



Once a coding system has been decided upon, it is possible to 

simplify the classification information by numeric codes. The following 

information can be inserted into the above tape : 

Sequence Number a temporary number used to keep 

track of input before keypunching 
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Year 
Type 
Number 

Cont inuat ion 
State 
City 
Schoo 1 
Level 

Related Subject Discipline 

Capac ity Classification 

Number Taking Objective 

Field 

Group 

Subgroup 

Block 

Unit 

Ob ject ive 
Exit Level 
Time 

Prerequisite Unit(s) 
Dependent Unit(s) 



the year the objective was written 
objective, test item, or media 
first card, second card, third card 
double check for second and third cards 



DirecLt . Pj:ar:eciuis.ite Unit (s) 

This is the answer to the question: 

o Which objective or objectives 
must be successfully completed 
before attempting this new 
unit objective? 

Direct D ependent Unit (s) 

•This is the answer to the question: 

o Which objective or objectives 
should sequentially follow the 
successful completion of this 
unit objective? 

Exit- Behavior 

This is the answer to the question: 

o Does successful completion 
of this objective give the 
trainee a marketable skill 
for entry level employment? 

Cap ability Classification 

This section is a check-list in three 
areas: psychomotor, cognitive, and related 
sub jects« 

Psychomotor 

This is an attempt to answer the questions 

• Does the accomplishment of this 
objective involve a significant 
amount of muscular activity? 

Cognitive 

This is an attempt to ansv;er the question: 

© Does this obj ective stress 
acquisition or application of 
* knowledge? 

o In other words, is this objective 
based more heavily upon memory or 
upon higher mental functions in its 
cognitive component? 
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Related Subject Discipline 

This is an attempt to answer the question: 

© Where does this objective tie 
into basic education as far as 
math or science is concerned?' 



Hindsigjht 

The careful reader of the above 
description of the typical behavioral or 
performance objective reporting form will 
notice two missing items: 

0 there is no place on the reporting 
form to prescribe hov7 the objectiv( 
in question is to be taught 

© there is no place on. the reporting; 
form to prescribe how the objectlv( 
^ in question is to be measu red , 

The reasons are simple: 

9 Rather , than specify specific meaiis, 
method, or procedures, a performanc 
objective leaves open a number of 
paths to its accomplishment 

o Rather than specify specific test 
items to be used to measure an 
objective, a performance makes it 
crystal clear by its conditions, 
performance; and extent exactly 
what is to be measured. 

• The emphasis is not on a particular 
thermometer test item which may or 
may not always function correctly 
but on the standard of excellence 
expected of the successful trainee, 

o Once excellence has been defined 
in clear cut terms, it should be 
much easier to achieve and'recogniz 



THE NEXT STEPS 



Starting to Think in Terms of 

What a Computerized Sys tem 

Can Do That an Individual Teacher Can' 



It is almost axiomatic that teachers have dreamed dreams 
that other teachers have fulfilled in later centuries or in later 
generations . 

With the aid of modern and existing computer technology, 
the modern teacher can see a portion of his dream come true in his 
own lifetime if not in a year or two. 

Going onto an automatic data processing or computerized 
system will not Xv^ork miracles, but it will save hours.,- days, weeks 
and even months of routine clerical tasks that must be done to 
achieve the kind of feedback that answers the simple quest ion , 
"Did my teaching accomplish what I set out to do?^^ 



DECISIONS TO MAKE 
• COMPUTER REjaHlRSMENTS. 

Here is an outline summary of things to be done to computerize the evaluation 
service center. 

(a) Ob jectives Onto Tape 

format of printout o Code 

c Condition 
o Performance 
o Extent 

ability to edit content proofread and revise content 

ability to add other classifiers 

Ammerson Melching 
othei:^ needed 

restructure USOE and content codes 

><\ 
<\ 

(b) Cross-Preference of Test Items ^\ 
Code ^1 
Different forms of same test ^1 



Levels of difficulty 
Alternate forms 

(c) Immediate S tatistics 

— Time Standards Option 

(Formulas I, II, III) 

Test Correction Option 

Profiles Individual, Class, Teacher, Course Program, School District, 
State 

(.d) Item Analysis (Exactly What Will Be Analyzed) 
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Decisions to Make 



In some ways, the transition from 
dreams to reality comes naturally and when 
one starts to make decisions. 

There are many areas to think over, 
' each of which requires an amount of 
•specificity that takes time to achieve: 

I 

© how to get the first versions of 
the performance objectives onto 
computer - readab le format 

o how to cross - reference the test 
items and other media support 
in a way that will facilita^te 
both entry and retrieval in a 
variety of formats 

e ho\^ to articulate the entire 
system in such a way. as to 
provide immediately necessary 
s tat is tics and long-range 
information needs 

® how to decide the type of item 
analys is required by the local 
educational agency and consistent 
with its budgetary limitations 

o how to decide which student 
ch aracteristics are necessary 
for later research and correlation 
studies to determine differential 
effects of various objectives 
u 

o how to decide on v;hich ongoing 
activities will receive priority 
or long-range status. 

Each one of these decisions must be 
broken down into a number of specifics. 

The following sections will look at 
each of them in turn. 



From Paper - and - Pencil t£ Computer - Readable 

Consideration must be given to two 
types of format r 

o the format filled out by participa 
teachers, educators, and all other 
sources of objectives 

o the format of the computer print-oi 
which must be mass'-dis tributed and' 
frequently referred to in the 
editing and selection process 

Thris will facilitate a number of thinj 
necessary to keep the item and objective 
bank active and up-to-date: 

o editing (major changes) 

© revisions (minor changes) 

o additions (new entries) 

G updating (constant renev;al) 

o broadening (humanistic goals). 

Software Considerations 



Some questions will be on a rather 
mundane level : 

o Should we use straight keypunching; 
or a combination of other methods 
to enter corrected data? 

o Should this be done by phys ica-tty- 
transporting the objectives or by 
a computer terminal and a long- 
distance phone call? 

©" How can cost and system requirement 
be optimally balanced? 

o How much confidence can we place 
in students, teachers, and 
administrators who will provide 
the balk of the input data? Must 
they be constantly supervised 
every step of the way? : 
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Examples : 



Typica l General D escriptors 



Basic Cross - Re fere nee Categories 

Despite, individual scliool needs, most 
local educational agencies will find it 
convenient to employ three general areas 
of cross-reference: 

o short-range general descriptors 

• » subject matter classifiers 

o long-range sequencing indices 

Verbal or Numeric Descriptors 

Verbal descriptors refer to words or 
abbreviations employ ing the normal alphabet. 

Numeric descriptors are a combination 
of numbers, letters, and symbols which are 
not usually derived from everyday language. 

As a practical norm, it is safe to 
s-ay that both v;ill be used by most coded 
cross-reference systems: 

o verbal descriptors will be 

used by teachers and supervisors 
as they write objectives 

o numeric descriptors will be 
used by editors and systems 
specialists v;ho prepare the 
objectives and items for 
.. entry into computer-readable 
format 



Illustration (Refer to Sample on Left ) 

Rather than devote unnecessary 
computer memory core to names of states, 
schools, and fields of curriculum, all 
these areas will be covered by appropriate 
numeric codes xi7hich can be entered into 
code number structures such as that 
illustrated on the left. 
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These v?ould include such things as: 
© state 
© city 
o school 

0 year objective was written 

9 teacher or teachers who write it 



Subject Matter 
Examples : Identification 

Subject matter or teaching unit 
identification would be based upon such 
things as the USOE code: 

o field (1st two digits; e.g. 17 .0000 
would indicate Trades and Industry) 

0 ^^"onp (3rd and 4th digits; e.g. 

17.0300 v;ould indicate Automotive 
Industries) 

o s ubgroup (5th and 6th digits; e.g. 

17.0301 would indicate Body and 
Fender) 

o block (7th and 8th digits; e.g. '■ 
17.03010300 could indicate Body Repaii 

o ^init (9th and 10th digits; e.g. 

17 . 03010307 could indicate estimating; 
costs) 

There are also other considerations: 

o exit (whether or not entry level 
job skill) 

® JL£Z£i (type and level where offered 
in school program) 

9 time (amount of instructional time 
envisioned to teach objective) 

© capabilit y classification (cognitive, : 
affective, or psychomotor domain) 

o n umbe r taking objective (how many 
students seeking this goal) 

e related subject discipline (related 
natural science or math background)/ 

61 



Examples ; Sequential Information 



Immediate Statistical Needs 



This is an attempt to determine tv;o 
things : 

e direct prerequisite units or 
objectives necessary 

a direct dependent or sequential 
objectives after, present goal 

, This will help determine which elements 

of the curriculum follow each other from two 
points of view: 

o what is actually taught in a 
particular order by teachers 

d what is actually learned in 
terms of student acheivement 
over a period of time 

o which goals mu$t... be achieved to 
succeed on a particular objective 

o which goals are appropriate for a 
student who completes a sequence 
before, with, or after the majority 
of other students 



C r OSS - Re f e r e n c in g l£ Never Le ft Unrevised 

The constant necessity to cross-reference 
and to ^retrive information on a variety of 
variables demands the ability to add other 
classifiers as the need might arise. 

0 This cd'uld occur vjhen a new 
break-through occurs in 
developing a successful 
classif ication "sys tern by 
a t&am of basic researchers. 

o This could occur when another 
bank of objectives is placed 
en masse into an existing 
classification. 

Such codes as the USOE system (six digits) 
will undoubtedly be used in the initial input. 
When such codes are found inadequate in their 
seventh' to tenth digits, it v;:I.ll be necessary 
to change the affected code digits. For the 
first time, data will be available with 
wi^nch to make these necessary corrections. 



These needs can assume a variety of 
forms. 

When a teacher starts working in the 
area of performance, he or .^he will find 
that certain theoretical bases of trainee 
success v/ill assume different forms: 

o the norma l distribution c^i y . vg . will 
not always be appropriate for 
measuring the success of students 
on objectives which every student 
is expected to achieve 100 per cent 

9 a distribution oi Lo^Lriiina tln)^^ is 
to be expected; this will give rise 
to the follovjing situations: 

e teachers will need add-Jtional 
later skill objectives or 
additional higher skills to 
correspond with variations in 
trainee learning time 

o if learning time remains a constant, 
then each objective will have to 
have a number of levels of 
accomplishment from basic minimum 
to more advanced skills 

Rather than rely upon traditional prete 
and post-test measurements, the accomplishme 
of performance objectives requires the stres 
upon growth or gains rather than relative 
position on a normal curve: 

o the measureme nt of ^ains will be 
difficult from a normal pretest 
situation since it could be physical 
dangerous to pretest trainees on 
certain heavy equipment 

o the a c tuaria 1 measurement of gains 
would also be necessary since not 
all trainees would be expected to 
grow or change at the same rate 

d the measurement of gains will 
probably center upon periods of 
time within the structure of a 
course; e.g. tests v;ill be given 
when a trainee is safely able to 
operate a machine on his own as a 
quasi-pretes t to be compared with a 
post-test measuring the effect of 
additional ins true tion 



ITEM ANALYSIS 



o The evaluation service center will develop a number of Objectives classified 
on a variety of categories. 



® Each objective will have a unique identifier: 

This will be a code number which includes among other things: 

© USOE code number (subject matter) 

o domain (cognitive, affective psychomotor) 

o other cross-identifiers and cross-classifiers 

o After the first year of testing, each objective will have corresponding test items 
with coded cross-references based on a number of things v;ith the 
ability to make the items more individualized and more accessible : 

o level of difficulty 

o predictability on next sequencial objective 

© Guttman Scale 

o success group correlated (v?ith student characteristics) 

o gains 'Rcojes 

© list of entry level occupational skills per child 



SUMiyiARY 



One Unit 



Cod< 



Object ive-Item 



Statistics 



Med ia 



Prescriptions 



e tc . 



DISPLAY 



Examples of Possible Statistical Services 



The limits of the human imagination 
seem to the principal limitations of the 
statistical possibilities of computerized 
data services. 

Here are a few of the many service 
packages that come to mind: 

® ^^^^ standards option x^hereby the 
teacher could receive pretest and 
post-test information -in three 
different configurations : 

i o peer group standards for 
quality and time 

ii o industrial standard for 
quality and time 

iii o industrial time standard 
for maximum quality only 

^ ^ correction option xvhercby the 

teacher could submit the answer cards 
or sheets of the students via an on- 
line computer telephone terminal and 
receive the results a few minutes 
later through the same terminal 

® student p rofile options are available 
for a number of things such as 
attendance reports, student report 
cards, automatically updated student 
records and transcripts, as vjell as 
profiles of progress along such 
dimensions as : 

o individual student 

o class average 

o teacher load 

o course program 

o individual school 

o department 

o school district 



Item Analysis 

Once each objective is coded, it will 

be possible to develop cross-references with 

such variables as: 



0 level (level of difficulty, level 
of previous training, level where 
the objective will be offered in 
school progran^) 

o predictability (trying to find where 
future successes are highly probable 
as a result of success on a given 
objective) 

o Guttman Scal e (one of the many 
attempts to scale items with a 
corresponding level of skill) 

® Success i^roup correlation (trying to 
find out which groups or which studen 
characteristics are highly correlated 
with success o.n particular items) 

o ^ains scores (trying to develop 
actuarial tables along a variety 
of cross-referenced student and 
program variables) 

o entry level occupa t iona 1 skills j 
(trying to ^establish interfacing 
of classroom objectives with such ^ 
things as computerized Job Banks 
and inventories of marketable 
skills) 

Item analysis is not an end in itself, 
but it is a good instrument of action once 
a local educational agency has decided what ti 
do with all the decision making data it 
has collected. 
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STUDENT 



RECORD 



VARIAg^LES 



Each Situdent will have a unique identifier based upon: 

o State 

d School District 

o School 

o Date of birth 

.o Social security number 

o Intellectual ability 

D Class rank 

o Other test scores — indicates areas to be further analyzed. I 

e Physical condition 

o Good health 
e> Handicapped 
o Attendance record 



o Socio-economic 



o Eamily 

o Parents 

0 Siblings 

0 Disadvantaged' 

o Minority group membership 

o Career goals-: lo undecided 

D Drop-out potential 



definite 



o Learning record 



© Class rank decile 

o Track in school 

o Disc iplinary 

o • High school grades 

o Hi'gh school grade point average 



Occupational record 



0 Field 

o Time in field 

o Grades in field 

o Number of courses 

c Part-time job 



grade average in occupational area 



o Related to field 
o Non-related 



SITMMARY 
One Unit: 
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student I.D. 



Background 



Performance 



student Records 



0 cultural disadvantage 



At the present time, there are a number 
of automatic data processing services that 
provide attendance reports, student records 
and transcripts by the simple act of pressing 
a computer button^ 

Each of these services is" justified on 
'its own merits • 

« 

The idea of this section ig to suggest 
trying such existing information units 
together into a compatible system. 



Why Bother t£ Develop Such a Com plicat ion 

An example easily comes to mind, ^The 
Vocational Education Act of 1963 was aware 
of the needs of students v;ith academic and 
socioeconomic handicaps. The 1968 Amendments 
made the disadvantaged a top priority item 
by requiring that 15% of the basic Federal 
allotment be used for them. 

There are many v^ays to identify the 
disadvantaged; not all of them are 
satisfactory but here are a few of them; 



o .:3cademic disadvantag e 

0 mental ability (loQ.) 

o lack of school success (doing 
poorly or failing) 

o dissatisfaction with school 

o irregular a±^teiidance 

® soei o-e conomic disadvantage 

o poverty 

© occupation of parents 

o disadvantaged neighborhood 



© family size 

o migration 

a parents ' education 

o marital status of parents 

o minority group membership 

o neglect 

o linguistic isolation 

9 other disadvantage s 

® physical 

© emotional 

0 delinquency 

It is obvious, when one considers such 
factors as minority group membership and 
parents* education, that such potential 
sources of disadvantage do not always 
irreparably harm each individual even 
though they may work against some. 

The Practical Concern Here 



The point under discussion when one triei 
to define disadvantaged in concrete terms is : 
not whether or not a particular item or a 
combination of tiems is an ac^equate 
definition. 

The more general area of concern is this 

o Can objectives be analyzed in 
such a way that various student 
characteristics will be found 
correlated with success on 
these objectives? 

© Can all of this be economically 
r-done by means of computerized data 
'systems that will merge as needed 
files on test data and student 
records that have up to the 
present been kept separate? 



Looking Ahead - Ongoing Activities 



TEST ITEMS 



Once a teacher starts using a system 
of performance objectives, related test 
Items, and other cross-referenced 
educational support tools, he soons finds 
out that he v;ants more„ 

Specifically, these usual demands 
touch the following general areas; 



© more test items (alternatives and 

new approaches to avoid the temptation 
to teaching to the "same old examination 

0 item analysis (replacement of defective 
items and development of basic statistic 
on such' things as level of difficulty 
or discrimination) 



OBJECTIVES 



CURRICULUM 



^ ^^yj-sions (minor changes in words, 
contents, and nuances) 

o editing (major changes in ideas, 
conditions , performances , and 
extent, and objective specificity) 



MsLltions, (adding more objectives 
to fill in missing areas in 
subject matter and curriculum) 

iinMtilLg (replacing outdated 
objectives as the state of the 
world of labor demands newer 
techniques or newer procedures 
for entry level employment) 

broadening (adding more objectives 
^to fill in necessary training 
goals by due attention to a balance 
of cognitive, affective, and 
psychomotor goals needed by 
trainees) 



° ^- Uditln g (finding out what is actually 
taught under the same course names 
across one of several states) 



structurinj^ (establishing the order of 
objectives based upon research on 
differential student achievement) 



XNDIVIDUALIZATION OF INSTRUCTION 



as sessment (giving a student or trainee 
an idea of where he is in terms of 
objectives accomplished in relation to 
entry level skills, to starting salary, 
and to style of learning) 



© direction (giving a student or trainee 
some specific idea of what. he can do 
next with great probability of success 
and of where this will lead him) 



o tailor - made objectives (showing a 

student v;here people with his type of 
achievement and personal traits have 
succeeded) 
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CURRICULUI^l : State Syllabus ? 

or a Tally of What Is Actually Taught 

in the Classrooms across One or More States 



On the level of existing printed syllabus, there is little 
doubt about v;hat is .being taught across a state. Fields of study are 
broken dov;n into major, groups , minor groups, and blocks. On the 
local level, these blocks are broken down into courses, units, and 
day-by-day classroom instruction. 

Because the generality of the state syllabus is designed for 
a wide audience and because the specificity of the local implementation 
is adapted to a more specialized clientele and job market, it is no 
great surpris.e to find a different point of view when tallies of 
performance objectives are compared with state curriculum guides. 
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THE PRECISE NATURE OF A STATEI^?IDE SYLLABUS 
A Dep . Ineat loll of Both Its Strengths and 
Limitations for Occupational Education 

A state syllabus or a statewide 
curriculum guide Is a multi-faceted tool: 

0 Often, it is the result of a 
committee of the most prominent 
teachers chosen across a state, 

d This means that much of the 
committee time must be speiit 
def ending,,local interests and 
making sure they are represented 
in the final document, 

o Limitations of time aiid printing 
budget mean that certain local 
programs that could >e successful 
in half a dozen. or more other 
similar comm.unities must be left 
out because they v;ill not fit into 
the., patterns of thirty or forty 
more typical situatioiiSo 

o Since the same objectives must be 
made to work in a school which 
offers fifty or more occupational 
programs and in a school which 
specializes only in one, there 
will be a certain amount of 
anticipated abstraction which 
must be adapted by local 
educational agencies o 

o When educational leaders get 

together to put out a curriculum 
guide, it can be assumed that it 
will incorporate the latest 
advances available at the time of 
writing. 

o One disadvantage of this approach: 
States of technology will not sit 
still until the next curriculum 
revision. 



o Another disadvantage: "Me-too" 
schools which lay out a lot of 
money for a 1970 shop in 1971 will 
be little inclined to spend more 
money to install a 1972 version until 
the 1973 version is recommended in the 
1975 revision of the curriculum guide; 
^ the time-lag gap still persists^ 
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THE WORK LOAD OF THE CLASSROOM TEACHER 



There Is Only So Much One Person Can Do 
No Matter How Important the Priority Is 

The classroom teacher has no shortage 
of things he must do: 

© he must be in the school from 
eight until four; his so-called 
free periods can be eaten up by: 

& prefecting assignments 

© papers to correct 

o noise in the school 

0 administrative paperwork 

o a variety of stressful prioritiej 

e he must be with students twenty-five 
periods or more a week 

Q this requires his full attention 
while in the classroom each day 

o this requires adequate lesson 
planning before coming to class 

Confrontation v7ith the State Curriculum 



There 'are a number of ways in which 
the cla'ssroom teacher can be given 
additional work because of the State 
syllabus : 

© his students must pass exams 
based upon common objectives 

o his lesson plains must be written 
in such a way as to make obvious 
how they implement the curriculum 

0 his supervisor is often mo I'e 
familiar with state demands and 
criteria than with the objectives 
chosen or derived by the individual; 
classroom teacher himself 

o his colleagues will sometimes tell 
him, "Even if it's out-dated, teach 
it since it. will be in the final 
exam or on the inspection report.'* 

Such a framework is the opposite 
of the one herein proposed. This 
proposed structure is intended to 
shift the teacher's role from that 
of spectator to that of participant. 
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where Do All These Difficulties Come From? 



Trying to Track Down Ansvjers 



Rather than go around suspecting the 
motivation of curriculum writars on t-he 
State or the local level, it might be a 
good idea to admit a very well known but 
unpublicized fact: 



Because of the format of educational 
objectives, it is virtually impossible 
at the present time to obtain data 
which will shov; how the State 
curriculum is implemented on the 
local levels 



Basically, this points to a preliminax 
question that must be answered: 



How do local schools continue 
the classification of subject 
matter beyond the USOE 
categories of Field of Study, 
l^jor Group, and Sub-Group? 



o This results in at least three 
specific information lacks: 



A tally of exactly what 
Portions of a State 
curriculum are implemented 
in classroom objectives. 

A tally of local options 
that have been proven 
successful and practical 
even though not mentioned 
in the official guides. 



Note : USOE Codes 



For those res ders not familiar with 
the USOE cJLassif icatioH into field jof 
study (e.g., IJ^oOOOO refers to Trades and 
Industry), major group (e.g., 17.01.00 refei 
to Air-Conditioning) , and sub -group (e.g., 
17,0101 refers to Cooling), the next three 
pages have been included to familiarize 
themselves with^ the overall coding scheme 
for occupational education^ 



© An estimate, based upon 
the results of actual ^ , 
classroom performance 
objective testing, of 
what per cent of cither 
statewide or local 
objectives attempted are 
actually learned by students 
and trainees in occupational 
programs. 



The Next Step 



Once this information has been 
obtained, it will become obvious that 
certain blocks are mentioned by a number 
of schools^ This lead to two distinct 
questions : 



Because the labor market must 
identify products of occupational 
education by documentation (e.g. 
high school diplomas, certificates, 
A.A, degrees, and other licenses) 
which reflects merely statewide 
objectives and not local options, 
it is not alv;ays easy to compare 
educational output with job demands* 



o Which blocks are mentioned by 
a vast majority of schools as 
being typical components of 
its courses under a given 
USOE code? 

• Which blocks are mentioned only 
by one school or only by a few 
schools? 
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OFFICE OF EDUCATION CODES 



AGRICULTURE 
(01 .0000) 



01.0100 Agricultural Production 
01.0200 Agricultural Supplies 

County Agent-Farm Insurance Adjuster 
01.0300 Agricultural Mechanics 
01.0400 Agricultural Products 
01.0500 Ornamental Horticulture 
01.0600 Agricultural Resources 
01.0700 Forestry 

01.9900 Other Agricultural (Specify) 
Teacher-Farm Exam Officer 



DISTRIBUTION & MARKETING 
(04.0000) 



04.0000 Marketing (General) 
04.0500 Floristry - Horticu 
04,0600 Food Distribution 
04.0800 General Merchandize 

' Mid Management 
04.2000 Retailing (Gen. /Mis.) 

Fash i on Reta i 1 i ng 
04.9900 Other Instructional Programs 



tura I Merchand i z i ng 
Management (Gen./Mis) 



N.E.C. 



(Speci fy) 



HEALTH OCCUPATIONS 
(07.0000) 



07.0100 Dental Services 

07.0101 Dental Asst. 

07.0103 Dental Lab. Tech. 

07.0199 Dental , Other 
07.0200 Medical Services 

07.0203 Medical Lab. Asst. 

07.0299 Medical Ser'vices (Other) 
07.0300 Nursing 

07.0302 Practical (Voc.) Nursing 

07.0399 Nursing (Other) 



HOME ECONOMICS 

09.0100 Homemaking - Preparation for Personal, Home and Family Living 
09.0101 Comprehensive Homemaking or Homo Economics 
09.1002 Child Development 

09.0103 Clothing and Textiles 

09.0104 Consumer Education 

09.0105 Fami ly Health 
09.0106. Family Relations 

09.0107 Foods, and Nutrition 

09.0108 Home Management 

09.0109 Housing and Home Furnishing 
09.0199 Other Homemaki ng (Specify) 
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09 . 0 200 Occ y pa+i ona -I - - -P-repa r^a+ ion 

09.0201 Care and G:uidonce of Children ""^ 

09.0202 Clothing Management, Production & Services 

09.0203 Food Management, Production & Services 
.09.0204 Home Furnishings, Equipment & Services 

09.0205 Institutional and Home Management & Supporting Services 

09.0299 Other Occupational Preparation (Specify) 

OFFICE OCCUPATIONS 
(14.0000) 



14.0100 Accounting & Computing 

14.0200 Business Data Processing System 

14.0300 Filing, Of f i ce Mach i nes. Gen. 

14.0700 Stenographic, Secretarial and 

14.9900 Other (Specify) 



Off i ce C I er i ca I 
Related 



and Typ i ng 



TECHNICAL 



Tech, 



16.0100 Engineering Related Tech. 

16.0102 Agricultural Tech. 

16.0103 Architectural Tech 

16.0106 Civ! I Tech. 

16.0107 Electrical Tech. 

16.0108 Electronics Tech. 
I 6. 0 I 09 EI ect ro-Mechan i ca I 

16.0111 Industrial Tech. 

16.0112 Instrumentation Tech. 

16.01 13 Mechanical Tech. 

16.0114 Metallurgical Tech. 
16.0117 Scientific Data Processing 
16.0199 Other Related - Optics Tech 

TRADES & INDUSTRY 
(17.0000) 



(Building Conslruct ion) 



V^el ding Tech. 



17.0100 Air Cond i t.i on t ng 
' . 17.0101 Cool ing 

17.0102 Heating 

17.0103 Ventilating (filtering & humi d i f i cat i on ) 
17.0199 Other Air Conditioning 

17.0200 AppI iance Repair 

I 7.020 I El ectrica I App I i ance 
I 7. 0300 Automot i ve ! ndustr i es 

17.0301 Body & Fender 

17.0302 - Mechanics 

17.0399 Other Automotive Industries (Specify) 
17.0700 Commercial Art Occ. 

17.0701 interior Decorating 

17.0702 Window Display 

17.0703 Product Design 

17.0799 Commercial Art Occ. - Other 
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17.1000 Construction & Maintenance Trades 

17. 1001 Carpentry 

17.1002 Electricity 

17.1005 Painting & Decorating 
■ 17.1007 Plumbing & Pipefitting 
17.1099 Construction & Maintenance - Other 
Drafting Occupation 
El ectrl ca I Occupations 
I7.M0I Industrial Electrician 
17-1499 Other Electrical Occ. 
Electronics Occ. 
17. I 501 Commun i cations 
17. 1502 Industrial . 
17.1599 Other Electronics Occ. '(Specify) 
Graph i c Arts Occ. 

17.1901 Composition, Makeup & Typesetting 

17.1902 Pri ntl ng' Press Occ. 

17.1903 Lithography, Photography & Platemaking 

17. 1904 Photoengravl ng 

17.1905 Silk Screening Making & Printing 
17.1999 Graphic Arts - Other Offset 



17. 1300 
17. 1400' 



17. 1500 



17. 1900 



17.2300 



17.2600 



17.2800 



17.2900 



17.3100 
17.3300 



17.3400 
17.3600 



Meta I work i ng Occ 
17.2302 Machine 



Shop 

Machine Tool Operation 
Sheet Meta I 
Welding & Cutting 
Other Meta I working Occ. (Specify) 
Precision Sheet Metal 
Meta I Fabri cat i on 
Services 
Cosmeto 1 ogy 

Other Personal Services (Specify) 
Pub 1 i c Serv i ce 
17.2801 Fireman Training 

Other Public Services (Specify) 
Food Ode. 
Baker 
Cook/Chef 
Wa i ter/Wa i tress 
Quantity Food Occ 



17.2303 
17.2305 
17.2306 
17.2399 



Persona I 

17.2602 

17.2699 



Other 

( 1 nterna I Combustion) 
Fabrication 



17.2899 
Quant i ty 
17.290! 
17.2902 
17.2904..-. 
17.2999 

Sma I I Eng i ne Repa i r 
Textile Production & 
I 7. 330 1 DressmakI ng 

17.3399 Other Textile Production & Fabrication - (Specify) 
LeatherworkI ng 

17.3401 Shoe Manufacturing 

17.3402 Shoe Repair 
Woodworki ng Occ. 

17.3601 Mi I Iwork & Cabinet-making 
1.-7.3699 Other Woodworking Occ, (Specify) 
Patternmaki ng 
House Carpentry 
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TALLY SHEETS 



Putting the Answers to These Quest ions 

to Work in Occupational Education Here are the results expressed in 

blocks taught and in frequency of schools 
Planning and Awareness On £ Statewide B asis teaching a particular block. 



Block 



Frequency 



Resu Its of Surveying Nine Schools 



Each school was asked to break down 
its major blocks under the USOE code of 
17.0302: 



• 22.0000 — Trades and Industry 



® 17»0300 — Automotive Industries 



o 17.0302 Mechanics 



It is to be remembered that by 
definition a blcTck is a further subdivision 
of the USOE code to the 7th and Stli digit. 

It must also be remembered that, 
as of 1971, no official coding system 
exists for the 7th and 8th digits even - 
though each state uses its own coding 
system for internal reporting or for 
reporting to USOE, 



The same constraints must be applied 
to all tentative attempts to specify 
exactly what is meant by the 9th and lOth 
digits which extend blocks into units 
of proposed classifying systems. 



The problem of local retrieval 
adds another dimension to the problem. 
Since each school has its own course 
numbers, these might well be considered 
as identifiers which would have an 
immense local acception and practical 
value by expressing the system in 
terms and formats already in local use. 



Engine 8 

Electrical 8 

Brakes 6 

Dr i ve ( Powe r ) Tr a i n 6 

Chassis 5 

Cooling 4^ 

Body 3 

Suspension 3 

Lubrication 3 

Tune -up 3 

Steering 2 

Carburetion 2 

Exhaust Sen/ ice .2 

STP Transmission Service 2 

Special Needs 2 

Rear Axle Service 2 

Air-Condit ioning 2 



Alignment 
Alternators . 
Generators 
Electrical Motors 
Tire Service 
Accessories 
Transmission Service 
Shop Orientation 
Engine Overhaul 
Testing/Measuring 



The above data is merely illustory 
and is not intended 'to be definitive. 
It is based on a small sample, none school 
only. 

The above data is merely illustratory 
and is not intended to be definitive. It 
is based on a small sample of only nine 
schools. Casual inspection of its - 
contents is all that is^ needed for the 
purpose it serves in this sec t ion. It 
does show that a tally of actual course 
blocks is a simple statistical concept. 



ANALYSIS 



Tying Data to Decisions 



This Survey Is 

Not Proposed as a Model of Data 
But as £ Model of D e c i s i o n - Ma k i n g 



Such a rapid survey \>?ill undoubtedly 
suffer from many sources of error; 

* 

o a sample size of nine schools is 
large enough for only a hasty 
overview 

© not all possibilities will be 
represented in such a limited 
sampling 

0 it was intended to provoke discussion 
and inquiry rather than provide 
definitive data 



Here are a few of the many activities 
that resulted from it : 

9 It became obvious that only five 
• areas (engine, electrical!, brakes, 
drive train, chassis) v?ould provide 
a great deal of feedback in comparing 
and contrasting program objectives. 

o Thus, rather than spend a lot of 
time subdividing such areas as 
tire service and accessories 
taught only by one school, it 
was decided to concentrate on 
.the areas with the greatest 
amount of possible feedback. 

_ © Similarly , .schpol^^^^^ only 

a few areas began to ask themselves 
why a particular area was not part 
of their approach. 

o This didn^t mean that all schools 
would adopt uniform programs, but 
it did mean that loca 1 ■ options 
were chosen by teachers fully 
aware of other local options 
quite different in scope and 
conception. 



Once the data on classroom objectives 
was in manageable form', it was natural for 
a lot of questions to be asked ;md for a 
lot of comparisons to be made: 

e Some began to as-k v?hy engine and 
tune-up were considered to be 
different blocks. and not part of 
each other? 

0 Some asked why there was an 

apparent difference betv7een such 
things as chassis and body? 
between STP transmission and 
transmission service? between 
colling and air-conditioning? 
betV7ecn electrical and alternators 
and generators? 

o After a while, the questions 
shifted from terminology and 
classification to the more 
fundamental question: 

o Exactly what is taught in 
a particular school under 
each of these blocks? 

© In other words, how does 
your school break down its 
blocks into units? 



m 
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Going Beyond Terminology and Provicialis 

Each state and each school has its 
own terminology and its own hierarchy of 
course ob j ectives . 

One advantage of such a tally as 
that examined above is that it allows * 
good teachers, even when from different 
states, to start working together."' 



Note; 

Such a survey will require additional' 
rigor and design to make it a source of 
actual block structure. 

However, it is proposed here merely 
as a vehicle to initiate the kind of 
thinking that must precede sending out 
the survey instruments- 



SKILLS AND ABILITY PATTERNS 



Five Schools in T^'70 States 



REQUIRED IN THE MARKET PLACE 
Making Sure That £ Local Education Agency 
Doing a_ Remarkable Job in Achieving 
Desired Student Performance Objectives 
* Has Relevance I to the Job Market 

This age --old dilemma in occupation 
education is not a problem that can be 
solved by comparing a computer printout 
of 10,000 performance objectives from 
one state with 12,000 performance 
objectives from another state. 

What is needed is a level of 
generality that shows what is happening 
in developing : 

• course level performance objectives, 

© entry level job skills, 

^ and a system, of tying them together. 

This must be in terms of a manageable 
list of ten to twenty occupational block 
variables and not in terms of thousands of 
specific units. 



An Example 

Recently, it V7as possible to compare 
the blocks into which auto body repairs 
(USOE code, 17.0201) was subdivided by 
three states: 

— — © two states which were trying to 

begin the coordination and mutual 
exchange of program objectives 
between various schools 

• one state which developed these 
occupational blocks from the 
point.s of views of both teachers 
and employers. 



Here are the occupational blocks and 
frequencies in a brief survey of auto 
body repairs in two states: 



blocks 



painting 



parts assembly 
panel assembly 
frame 



frequency 

3 

2 
2 
2 



metal repair 
fundamentals of metal 
theory and application 

of welding 
materials for body prepar^^tion 

preparat ion 
hydraulics 
estim'ating 
glass 

mechanical parts replacement - 
spray gun 

used car conditioning 

surfaces 

chromes 

rus t and rot repair 
delivery 
paiiit types 
paint problems 
paint es timating 



A rapid overview of this survey shows, 
that it reflects ^many local issues: 

o some schools work on a 

production basis where by students 
are taught to repair actual cars 
as they come in off the street 



not all of these schools agree on 
the level of c omp 1 ex i t y i nd ic a t ed 
by a block (e.g. all the items 
related to painting) 



some of the titles seem to stress 
physics (e.g. hydraulics) rather 
than auto body repair 

attitudes necessary for employment 
are novyhere obvious even though 
one could suppose that a trainee 
with a good disposition could 
learn quite a bit through 
on-the-job training 
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One State ComparlnR Teachers and Employers 

This study was done on two levels, the 
block terminology level and the unit skill 
level . 

Terminology Level 

There- - v?a-s— naL— troo'~mut: h difference 

[between teachers and employ iirs when it 
came to pinpointing the names of areas 
^necessary for auto body ropair occupational 
- training in one state. 

Here is a listing of the nine areas 
teachers and employers considered to be the 
main occupational blocks; eight of them V7ere 
oriented towards skill and knowledge; the 
ninth v/as composed of thirteen desirable 
occupational attitudes. 

Welding 

Metal Straightening 
Body and Frame Repair 
Fiber Glass Body Repair 
Ref inishing 
Glass Replacement 
Pane 1 Re.pl a c eme n t 
Estimating 

Thirteen Desirable Occupational Attitudes 
Unit Skill Level 

Once there v;as unanimity on the names 
of the necessary occupational blocks, it 
was found helpful to subdivide these 
dowa into specific units. 

As long as the units rested on the 
name and terminology level, it was still 
possible to find a degree of unanimity. 

Each group v;as asked to spell out t>;o 
sorts of specifications: 

e exactly what was to be performed 
by the o'bjectives in each unit 

• exactly hcxv' it v;as to be measured 



The Apparent Differences 

The findings of this survey seemed 
to indicate that : 

9 teachers seemed to place greater 
emphasis on the knowledge level 
of such things as welding than 
employers do 

• ..employers seemed to require a 

higher level of skill in such 
things as refinishing than did 
teachers , 

e employe-rs^ were av;are that a student 
with average or above-average 
intelligence can learn quite a 
bit through on-the-job training 
if he is willing to learn 

0 in many cases, willing to learn 
meant having the right attitude 
as defined by the employer 

One interesting item, "The Right 
Attitude ; Learning on-the-job," will 
be developed in a separate section. 

Implications of Such Research . ,■ . 

With the assistance provided .by an 
item and objective bank, a local educationa 
agency will be able to see if it is doing 
a good job meeting the objectives chosen 
by its teachers. The LEA has then answered 
two ques tions ; 

o "Wh'ic are we trying to do?" 

• "How well have we done it?" 



Once this first goal of self- 
accountability has been attained. It would 
be possible for the school to ask itself 
some more fundamental questions: 

o "Are the objectives we have 
chosen really relevant to the 
demands of the job market?" 

0 "How well do our objectives 

•square with the skill and ability 
patterns required in the market 
place?" 

7V 
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Da r.e. m ining l!ow W_el_l Ob 1 ectives Are Attained 
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PERJ'ORMANCE TESTING : Putting Research to Work 

for the Classroo m Teacher " 
Interested in Industrial Standards 



Many teachers feel that a combination of perrprmance objectives 
as a rough guide and industrial standards as a measuring rod creates a 
team that can improve the teaching-learning process. 

The question arises, ''How did such teamwork develop?'* 

The answer is simple : Interested educators said they would 
like to have information available to them providing peer group standards, 
industrial quality standards, and industrial time standards but it would 
take too much time for an individual teacher. 

Computer programs were then set up to get this valuable evaluation 
information into the hands of educators. It is a two-way street : the 
teacher' recel-ves--a-heli)ful-serv and the researchers receive information 
from the resulting feedback that continually improvides the quality and 
the specificity of the service rendered. 
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What the 'Teacher Does 



1 — Performance and Behavioral Objective s 



For each item the teacher wants evaluated 
he submits a performance objective in a format 
vhich includes : 

o cross-referenced coding 

o conditions, performance, and extent 
of the particular objective. 

In actual practice, this includes the 
following previous activities: 

0 decisions about what is essential 
and what is incidential in the 
conception of a particular course 
on the local educational agency 
level * 

o selection of objectives from lists 
constructed and written by teachers 
giving similar courses 

o v^riting and cross-referencing only 
that local objectives x^?hich are not 
available elsewhere through use of 
the computer feedback system. 



2 — Cross - Referenced Te s t Items 

For each objective, the teacher will 
construct a corresponding test item. 

Those tests which combine several 
objectives and items into a single evaluat 
instrument would seem to be of high priori 
at this point. 

In actual practice, this includes the 
follow^ ing activities : 

o going over old examinations^ both 
paper-and-pencil and psychomotor, 
and deciding whether or not a 
particular item really gives the 
type of information needed by the 
school, teachers, and trainees 

o if a particular item is valuable, 
then it must be related to an obje< 
tive to establish its priority; 
otherwise, it is removed from cons: 
eration as a prime concern. 

o often a clearly written performance 
objective will make the test item 
obvious or self-evident 

o once test itmes have been cross- 
referenced v;ith essential and inci^ 
• tal objectives, it will often be : 
necessary to construct new test ite 
to measure essential objectives tha 
are not currently being adequately 
evaluated by existing testing 
instruments. 
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Goal: Management , Not Merely Enumeration 



3-- Test Data 



' Rather than become bogged down in 
insurmountable paperwork, the teacher should 
realize that his task is to gain control of 
the educational situation. 

At the moment of entering upon a feedback 
system, the prime consideration is not that 
every course have every possible terminal 
and enabling objective clearly v;ritten up in 
a file cabinet somewhere. 

The important thing is that teachers begin 
to decide v;hich objectives are really worth 
teaching and measuring. Rather than get 
swamped, in details, it is suggested that 
teachers start with the most- important objec- 
tives of their courses. Once these are taken 
care of, the teacher will be able in later 
work to spell out Incidental learnings which 
are important but v?hich are not as essential 
as the prime importance objectives which must 
be learned by every successful trainee and 
student. 

A real feedback system will give the 
foIlo*v7ing capabilities to each participant: 

© the abilit)^ to edit, adapt, and ' 
rewrite objectives to fit nev; needs 
and nev; conceptions 

o the ability to profit from the 
successful and well written 
objectives; and iteras of others 

o the ability to revise one * s own 
curriculum without having to 
choose objectives for v;hich no 
support (clear statement, test 
items, and cross -referenced 
media) exists. 



Once the participant has decided upon 
*'his or her objectives," i.e., those objec-j 
tives which have been personally vjritten or. 
chosen from the work of others, student and' 
test data are necessary for a complete 
analysis. 

For each student, the teacher will pro\ 
the following information in tabular for dat 
processing form: 

o student number (the complete 

computerized file is necessary only 
the first time) 

o evaluation of each item (maximum of 
ten itmes per test); this will usual 
be in the form of quality points 
ranging from 0 to 9 

G working time in minutes. 

For each batch, the teacher will provid 
the following identification: 

Q instructor code 

Q school code 

© job code 
♦ 

o maximum number of quality points 

© Tj[ - Time of industrial standard o 
of experienced operator 

^ Qi " Industrial standard quality 
points or of experienced 
operator 
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Servic e , Not MonollL-'hic Slmi larity 



The above procedures are for those 
educators interested in having data on peer, 
quality, and time standards in the correction 
of examinations. 

Rather than appear as sC prescription for 
-all educational institutions, it is proposed 
as merely an example of the tailor-made 
.options available. 

System ^ Non Immutable S tability 

The above procedures are for those 
educators who realize that their first efforts 
at writing object ives - and cross-referenced 
test items will not always give inuiiediate 
results of the hightest possible quality, 

Hovjever, with a systematic approach ^ 
teachers and other educators v;ill be able 
to update, edit, and revise both their 
objectives and test items. 

This means that the system will try to 
set up the computerized hardware, necessary 
to make this possible. 

Structure , viot Unprocessed D ata 

The above procedures are designed to 
facilitate an intellectual audit of the 
widest possible^ scope. 

Rather than say that the following 
courses are taught at a particular local 
educational agency, it will be possible to 
spell out with performance objectives exactly 
what is taught under a particular course name. 

In time, it will be possible to spell 
iihis out in terms of entry level job skills. 



What the Teacher Will Recei-^^e 



For every objective and cross- re feren< 
test item submitted, the instructor could 
receive the following: 

o total quality points for each stud^ 

o average working time of the group 

o results of Formula I for each 
student (peer group standard) 

o results of Formula II for each 
student (industrial standard) 

© results of Formula III for each 
student (industrial time standard 
for maximum quality work only) 

o efficiency score (I, II, or' III) 

0 trainee efficiency measured as 
percent of Industrial standard 

G average group time- 

o average efficiency score 

o average trainee efficiency measuren 
as percent of industrial standard 

o if a retest is desired, all the abc 
is available plus the following 
comparisons (tes t/retest) for both 
individuals .and group percent loss 
or gain by efficiency scores 

o percent loss of gain by industri 
standards 

o statistical significance of loss 
or gain 

Individual adaptations of the above ai 
alv?ays available to respond better to local 
needs ancl goals . 
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CONFERENCE FEEDBACK : Using ^ Goal Awareness 

Instead of 
Speaker-by-Speaker 
Evalua t ion 



The typical results of a conference evaluation, no matter, 
how long or how short the evaluation instrument used, come out looking 
like thiSj^^jast yearns conference was considered a success; yet we 
cannot pinpoint the strong points. Similarly, last year's 
conference received a certain amount of criticism; yet we cannot 
pinpoint the items we want to change." 

The use of conference goals expressed in terms of performance 
objectives is^ an attempt to see what factors made the conference 
successful and what factors caused criticism on the part of those 
attending. It*s an attempt to attain this two-fold goal without 
having to blame any particular conference speaker; it realizes that 
a successful conference is a result- of both participants and leaders. . 



8 o 



OVERALL COALS: 1971 



Conference: Manpower Prioritiies in t:he 1970 's 
I • ■ ■ ' 

In order to understand' our conference, it 
is necessary to understand its goals. Its 
three principal goals can be summed up by 
^three adjectives: 

(1) humanistic, 

(2) informative, and 

(3) paperv;ork. 



Humanistic means that v;e Xv^ant thir>- 
conference to give us an opportunity to get 
to knox^ each other, to exchange experiences, 
and to stress the human side of our v,"'ork. 

Informative means that v?e x^ant this 
conference to explain to you the recent 
legislation, innovations, and brueaucrat ic 
change-s- that directly effect our manpov;er 
programs. 

Paperwork means that this necessary part 
of our job does involve a few changes in 
procedures. 

By presenting the objective's of our 
conference in these terms, we are trying to 
give you a clearer idea of exactly what we 
want to do » The next few paragraphs will try 
to make this idea even more specific so that 
when it comes time to evaluate our conference, 
each of us will be able to do so with a 
clearer idea of how well we have-" obta ined our 
objectives . 

Here are the type of questions \\^e are 
going to ask to find out if our conference 
has been humanistic. 



o Have you met ten manpower v^orkers 
you have never mat before and spent 
some time exchanging ideas v;ith them? 

e Have you found at least one person 
at this vast conference who does 
the same type of work as you? 

r 
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® Have you exchanged comments, criticisms 
and problems Xvlth this person? 



9 Have you learned at least one good idea; 
from a fellow participant? 

o Have you passed on at least one good idl 
, to a fellow participant? 

o Have you tracked down and met in person 
at least two or three of the people. witl 
whom you have had many telephone calls 
but vhom you have never met? 

Here are the type of questions we are 
going to ask to find out if our conference; 
has been informative. - 

o Have the changes in legislation been 
explained to you in an understandable 
fashion? 



© Have your questions beexi answered in a 
way that leaves you satisfied? 

o Have 3^ou received printed summaries of 
the most important legislation changes? 



o Do you know whom to telephone v7hen an 
interpretation difficulty emerges? 

Do you know what documents are essential 
to help you understand these legislative 
changes? 

o Do you understand the new deadlines for ; 
the coming fiscal year? 

o Do you understand what money has been 
cut out? 



a Do you understand V7hat new programs 
have been authorized? 



Here are the types of questions we are 
going to ask to find out if our conference 
has placed our necessary paperwork in 
perspective. 



Do you understand v.^hat proeed-ure-s -. 
have been changed in working with 
the manpower office? 



Has someone listened to your helpful 
suggestions on how to speed up the 
process? 



Do you understand the reasons why 
certain documents require large 
number of copies? 



These objectives seem quite complicate 
but when you-., look at the v;ay we are going 
to evaluate thern, you will have to admit 
that the average man in the street who 
knows nothing about our manpower programs 
v?ould be able to answer almost everyone 
of these questions simply by observing. 
If we gave him the three words, humanistic 
informative, and paperwork without our 
evaluation questions, he would have no 
idea of where to begin. This is all \>7e 
want to do this year in ex'aluating our 
conference. We doubt very much if we will 
_ c h a n g e ;^p u r _t h r e e ke y „ w o r d s a y e a r f r o m no\-i, 
but we do hope that you will be able to 
suggest to us better questions that we can^ 
use next year in evaluating our annual 
manpower conference. We are all in this 
evaluation togetlier* and V7e all hope that 
once we start getting specifics we can 
start making improvements. 
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Do you understand exactly what takes 
so much time to process certain 
documents ? 



Do you understand the reasons behind 
certain directions which are very 
specific and detailed? 



Have you actually spoken to two or 
three of the people who vrill be 
handling the paperwork you send in? 



The effectiveness of each aspect of the 
conference will be assessed through brief 
exposure of conferees to audio-visual stimuli 
coupled with the immediate elicitation of 
responses to relevant statements of questions. 
As a basis for preparation of feedback materials, 
each panel chairman is asked to do the following: 



The 1971 Manpov;er Conference Evaluati( 
will follow a format different from that 
used in previous years. Emphasis will be 
placed on feedback from conferences w^ithin 
humanistic, informative and administrative; 
structure . 

The humanistic aspect relates to the 
provision of a milieu in which Conference 
participants are able to meet both formally 
and informally, exchange experiences and 
establish a personal working relationship. 

The informative aspect relates to the 
exchange of information pertinent to man- 
power related programs . 

The ad m i n is t r a t i v e aspect relates to 
presentation, explanation and discussion o: 
changes in procedure in the planning and 
implementation of manpower programs. 



Prepare a brief statement of not more 
than four objectives for his panel * s 
presentation in terms of desired audience 
reaction and feedback , 



Solicit a similar statement from each 
panel member. 
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Some Performance Ob j ectives 

for Cogf erence Speakers 



Here are a few behaviors ear;y to identify; 
they are often more due to carelessness 
than to ignor:':rxe. 

. Time and length 

the speaker spoke too long 

• members of the audience were evidently 

bored; they yawned, etc. 

other speakers were unable to deliver 

their entire presentations 

the main idea of the lengthy speaker 

got lost and smothered in a super- 
abundance of secondary ideas and 
personal comments 

the speaker was surprised and unpre- 
pared for audience misunderstanding 
of and opposition to his ideas 

not too many are sure of the main idea 

Feed bac k 

the audience did not want to ask 

any clarif^'ing questions 
the speaker v;as able to squelch any 

challenges to any of his ideas 
the speaker d.':ininated the question and 

answer session after the presentation 

Clar j f i cguion of Ideas 

many in the audience coa^pletsly 

misinterpi-e ted the main speaker 
v;hen asked a question, the main speaker 
merely repeated exactly v;hat he had 
said or read earlier 

the speaker overstressed non-essentials 

Variety of Presentat ion 

the speaker seems to be aware of no , 

other way to convey his ideas than 
by reading his prepared comments 

" the audience is impressed v;ith the 

breadth of his coverage even though 
many members are not able to understand 
exactly what he was getting at 

the speaker is completely unaware of 

what is happening while he talks 
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Here are common, sense cures; they 
require a bit of discipline to Improve 
your presentation. 

h Clearly Defined Goal 

the speaker chose only one essential . 

idea and stuck to it 
• the audience responded to it with 

clarifying ques-tions 

the emotional reaction of the audienc< 

was obvious; it got the message 
the speaker seemed able to anticipate 
and handle the audience reaction 
not everyone in the audience agreed 
with the speaker, but most seemed to 
understand what he was 'talking about 

the main idea is cler^rly not 

subordinated to secondary details 

A Cooperative En d e avo r 

the audience began to ask the speaker 

and each other intelligent questions 

the speaker became more an expert 

consultant than the dominant speaker 

unexpected questions did not throw 

the speaker 

A S t ep -by-S t CD In t e r p r 0 1 a t ion 

the speaker didn't use a lot of notes 

he liad one main idea which he presents 

in a variety of ways until it sunk in 

^ he clearly identified correct and 

incorrect Interpretations of what he : 
intended to present- to the group 

ii:. S t e j) beyond Technique to Dialogue 

the speaker used a minimum of notes ^ 

_ he used one or two visual aids 

similarly, he used common sense 

examples and comparisons 

he maintained eye-to-eye contact with 

the group to determine their reactioni 

he tried successfully to evoke 

audience reaction and involvement 
he gave examples from his own experiei 
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BUILT-IN EVALUATION : Trying t:o Put 

Evaluative Criteria 
in TeriHsS 

the Man on the Street Can Understand 



Even the most: simple operation can be made more co.nplica ted 
them necessary if one doesn't constantly ask the question, *'What clear 
visible and easily observable difference is the objective of all this 
activity?" 

Not all worthwhile goals are readily verbalized; many a 
worthwhile objective must be approximated rather than definitively 
spelled out by a written description. 

However, this does not mean that putting a priority on 
clarity is impossible. When the man on the street understands in 
his own language, he will be in a better position to evaluate the 
uses being made of his tax dollar. 



Eva lu at ion 

When one boils down the rules of 
evaluation, two questions remain 
fundamental : 

o What is this activity trying 
to do? 

o How well has it done it? 



Once these tv;o questions are answered 
in simple terms, it is possible to base 
decisions upon evaluation. 

If these two questions remain 
unansv7ered, then all the evaluation 
forms, questionnaires, barometers, and 
checklists will not help much. 

A£plyj.p^^ This^ to Proposal J^^[<lhjacion 

Whenever any agency tries to evaluate 
a large number of proposals, it develops 
a set of guidelines or priorities to 
help clarify its own thinking. 

Once this has been, done, there still 
remain other problem areas : 

o Often there is not enough time to 
read all the proposals that 
come in for evaluation. 

o Vague words in even the best of 
proposals often make it difficult 
to understand exactly what the 
author was trying to say. 

o In retrospect, it often happens 
that a project that looked good 
in the proposal stage does not 
live up to its expectations. 

o Similarly, it is not unusual for 
a project that looked very non- 
sensational in the proposal stage 
to become a pacesetter in 
its domain. 



Typical Evaluation Result s 

According to the typical self- 
evaluation which is the only kind found 
in most projects, it is possible to 
detect a j^eit motif lil;e this : 

o "If only our project had had 
more money, it would have 
produced more results of a 
higher quality levell" 

o "Because our budp^et was cut, 
we had to eliminate the most 
valuable parts and consequently 
. , the results are inconclusive." 



it £iJL^£iL£.ni l^^l^ g Sophy of- Eva luation 

Once evaluation starts thinking in 
terms of a pre-defined product ,. which 
is clearly visible, it becomes a lot 
easier to recogni;?',e success or the lack 
thereof . 

Thinking in terms of product is a 
different approach to research dollars. 

o Re search S pending Pol lars is a 
■ concept familiar to anypne v.'ho 
has ever locked at a research 
budget. Example : In order to 
solve this problem, it will 
cost 5,000 dollars. 

® ^^JiSJU-Sh _Sj av^lag Dollars is a concept 
that is not quite so familiar. 
Example : Unless v/e find a cure to 
this problem, it will cost the 
State 10,000 dollars. 

^ ^gsearch Prod uc ing Pol lars is an 

idea still less familiar. Example : 
Solving this problem will raise 
the Gross National Product by 
50,000 dollars. 
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The Unique Natrure of. This Evaluation 
Basic Activities 

The proposal selected will have to 
outline the approach taken to do two 
inter-related activities : 

o evaluate past EPDA-funded 
programs according to EPDA's 
four goals and, 

o help future EPDA proposal 
writers to provide built-in 
evaluation for their projects. 

What This Entails 



PAST PROJECTS : Rather than merely 
give each project a report card type grade 
on a number of variables', it v;ill be necessar^'^ 
to search out : 

^ program objectives that functioned 
effectively in opening the eyes of 
teachers and administrators to the 
reality of the world of work in 
such a way that desirable change 
was introduced into the classroom 
functioning of occupational 
programs ... 

o classroom ob j ectives that did 
work effectively in helping 
students -obtain a cor.rect 
understanding and attitudinal 
orientation toward what the 
world or work is like now and 
will be like when it v;ill be 
time for these students to enter 
the work -force. 

Here are a few helpful definitions: 

^ desi rable obj ectiv es simply refer 
to those objectives which have 
given a true picture of the world 
of work 

9 effective obj ectives are simply 
those desirable objectives which 
have been documented and proven 
by actual classroom success to 
produce the results sought. 

O 
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FUTURE PROJECTS : Rather than tell 
future proposal writers what to do, the 
evaluation report will present its 
documentation in such a v;ay as to 
facilitate several professional activities:. 

© the selection from past projects of-. 
areas which did work effectively 

o the construction of other approaches 
which v^ill provide built-in 
evaluation to measure their 
effectiveness' of ineffectiveness 

o the ability to build upon the " 
successes of previous EPDA project 
and to avoid dead-ends clearly 
identified as such. 



Implications of All This Documentation 

At the present tiem, it is indeed rare 
to find a project that has been declared 
even a partial failure by self -eva luat ion ; 
except for lack of time, or money, or 
personnel . 

Under the system of built-in evaluatior 
it will no longer be possible to declare a 
project either a complete success or a 
complete failure. . 

o . This, will, mean that each segment 
of a project will have its ov?n 
objectives, its own price tags, 
and its own criteria, 

a In the case of two successful 
components which both attained 
the same objectives, it will be 
possible to compare results on * 
acostbasis. 

o In the case of two programs with 
identical goals, one of which was 
successful with a smaller budget, 
it will be possible to make some 
interesting comparisons. 

© There will be components of programs 
which will be declared complete 
disasters; this will not void the 
benefits of other segments of the 
program, but it will provide 
information on objectives and • 
approaches that are documented to 
8 [) be unsound . 



Introduction 



This opening section gave the backgroun 
of the EPDA funding and its general objectiv 



Trying to Develop Built -in revaluation 



Specifications 



Focus 



The attached request for proposals was 
developed in. an attempt to spell out in 
everyday language exactly what kind of 
evaluation is wanted to furnish the basis 
for several activities: 

© in-service training for occupational 
educators 

o pre-vocational awareness of the 
world of work 

o curriculum development for 
occupational relevancy 

o updating of vocational counseling 
skills on the elementary, secondary, 
and post-secondary levels 

Each section of the request for proposals 
was developed for the purpose of clarifying 
exactly V7hat was needed. 



Rather than remain with the general 
terms of the introduction, this section 
tried to spell out how all of these 
generalized goals could be observed 
in terms of changed classroom behavior 
of- the participants. 



Level £f Specificity 

This section tried to list specific 
concerns that could be considered in making 
the product of this evaluation observable. 



Level of Practicality 



This section tried to spell out the 
specific purposes for which this evaluation 
material would be used. 



This section also spelled out in 
terms of resulting documents exactly what 
kind of format the final report would be 
expected to take . 



In addition to format, this section 
gave examples of the areas of interest for 
each of- the four major priority areas. 
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Criteria for Selection 



"External Documen tat ioii 

This section tried to make it clear 
that the v;orlcl of v;ork must also be consulted 
to avoid the possibility that the resulting 
documentation was strictly academic and not 
occupational in the strictest sense of the 
word . 

Contents of the Proposal 
Length of the Proposal 
Cppies 
Budget 

Deadlines 

Notifications 

A dditional Specif 1 cations 

Ma iling Addre ss 

Additional Ques t ions 

These sections were intended to supply 
such specif ic information a$ who, what, where, 
v;hen, aiid hov?o 



One of the first things any reviewing 
agency does is to determine its criteria 
for success or failure. 



Sometimes, this is kept an official 
secret. It is feared that, if the 
selection criteria were knovni, proposals 
would be written simply to please the 
reviewers in order to be funded^ 



The criteria for selection were not 
kept a secret in this request for proposal. 

The thinking beliind this V7as simple: 

o If a proposal will be judged 
against a certain set of 
standards, it seems best to 
equalize all bidders by making 
public the standards required. 

o Rather than keep the criteria 
a secret, v/hich is a bit like 
teaciiers keeping the final 
exam questions under cover, it 
was felt better to state " . 
explicitly what was expected. 

In this way, it was thought more 
appropriate to spell out in as much 
detail as possible the overall goal 
of the request for proposals which V7as : 
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REQUEST FOR PROPOSALS 



To develop a set of documented techniques and procedures 



o that will help evaluate past EPDA-funded programs 
according to RPDA's fourfold goal structure and " 
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that v/ill help future EPDA proposal writers 

to provide built-in evaluation for their projects 

through the use of clearly expressed and 

precisely measurable program objectives 

in occupational education in-service training. 



In troduc t ion 



The Bureau of In-Service Education of 
the New York State Education Department has 
been funding projects under the Education 
Professions Development Act, Part Section 
553. 



d) To provide opportunities for 
guidance and counseling 
personnel to develop greater 
proficiency in providing 
vocational counseling at the 
elementary, secondary, and 
pos t -secondary levels . 



In the summer of 1970, five two-year 
colleges conduct-d in-service training 
programs with the purpose of improving the 
skills of occupational teachers to accomplish 
four goals ; 

a) To provide opportunities for 

vocational educators (secondary 
and post-secondary) to gain 
greater insight and skill in 
working with, and developing 
pertinent programs for, 
disadvantaged and handicapped 
youth. 

^) To provide opportunities for 
expanding pilot efforts to 
introduce elementary and middle 
school personnel to, and increase 
their understanding of, the world 
of v;ork, so that they may more 
effectively work with young 
children in providing occupational 
education orientationo 

c) To provide opportunities for local 
school adminis tra tors to gain 
adequa te in forma t ion and develop 
expertise which will enable them 
to prepare relevant program 
objectives as x^ell as develop and 
implement short and long-range 
program plans . 



In the summer of 1971, five tv7o-year 
collo ges will be funded to conduct programs] 
designed to^ implement the same goals. 

These are the programs to be evaluated 



Specifications 

Focus: The guiding principle behind 
the evaluation is to answer the question: 
"What's different in the classroom pcrforma 
of the teachers who participated in tliese 
inservice sess ions ? " 

9 In other words, "How has their 
in-service training helped them 
become more responsive to the 
four-fold goal of EPDA?" 

o "If nothing has changed in their 
classroom or in their students, 
then v;hy not?" 

• "What precise part of their in-serv: 
training was instrumental in bringii 
about these desired changes?" 

o "What precise part of their in-serv: 
training did not contribute to the 
realization of these fourfold goals' 
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Level of Specificity ; Such ans^s^ers to the 
above question as "My attitude improved" 
or "My teaching became more practical" should 
be spello.d out into concrete behavior or 
classroom performances that can be employed 
by other teachers in similar situations. 

This would include but would" not be 
limited to such specific things as: 

u classroom teaching techniques that 
worked v;ith disadvantaged students, 
an assessment of why and how they 
worked, and a clear-cut description 
of what is meant by success; 

« classroom techniques that didn't 
work and the reasons why; 

o similar approaches to elementary and 
middle school students; 

o specific changes in school programs 
made'} by administrators to respond 
to relevant program objectives; 

© specific changes in the methods and 
effectiveness of guidance personnel 
to deliver vocational and occupational 
counseling that meets the varying 
needs of elementary, secondary, and 
pos t- secondary students; 

o delineation of" the precise nature of 
the varying; counseling needs of these 
different audiences. 



Level of Practicality : The resulting documents 
of this evaluation V7ill be expected to provide 
all the procedures and details necessary to: 

o evaluate past and present EPDA- 
projects as specified herein 

o. provide guidelines for those 
interested in writing future 
proposals which will include 
built-in evaluation and research 
potentials. 



The resulting documents will be 
composed of the following sections, each 
■one of whicli should be capable of being 
free-standing and reproducable on its own: 

o the evaluation process used 

o pre-project training techniques' 
that will prepare teachers for 
this type of work 

0 project activities that have 
worked with students 

©V project activities that have 
worked with teachers 

e goals written in performance or 
behavioral objective terms that 
spell out what teachers can do or 
learn as a result of EPDA 

o goals written in performance 

objective terms that spell out what 
students should be able to do as a 
result of their teacher's EPDi\ 

o guidelines to writers of future 

proposals on how to develop built-ii 

. - evaluation and research potential 
for the proposals they submit 

0 development of performance or 

behavioral objectives and developmei 
of a format for the construction of: 
other performance objectives in the; 
area of: 

• awareness of the vjorld of work 
for elementary and middle school 
students 

o skills and insight needed by 

teachers to work with disadvantaj 
and handicapped youth in 
occupat ional educat ion 

9 expertise needed by adminis tratic 
to harmonize their program plannj 
with relevance to the actual 
demands of the world of work 

© skills needed by counselors to 
provide vocational counseling at 
three levels : 
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9 elementary 

o secondary, and 

e post- secondary. 



Extiernal Documonl'a t:i on : Reasonable checks 
must be builL into the proposal to assure 
that the documents produced as a result of 
this evaluation reflect the needs of the 
school and the expressed needs of the \^orld 
of work. 



Contents of _the Proposal ; The proposal should 
include; 

9 method of meeting specifications 

o methodology and design of study 

o unique aspects of the project 

o budget and cost efficiency 

9 description of the documents 
which will constitute the final 
report. ; 

o vitae of principal investigators 



Notification ; Those selected will be 
notified by te lephone . 



Additional Specif lea t Ions For more precij 
information about details of a 1 leviable 
budget items and project activities, it is 
presumed that those submitting proposals ai 
familiar with the EPDA guidelines. 



Hailing ^ Addre ss_ 



Proposals sliould 
be sent to the consultant' "with 
whom you have been in contacb>v-- 



Additional Ques tions : Should any 
clari f icatioas be required, please 
call for more information. 



Leng j th of P roposal : Obviously a ful!b' developed 
proposal would go a long V7ay tov;ards developing 
the final product, but this would take too 
long. 

The,refore, the proposal submitted for. 
funding should emphasize ideas, implementation 
strategies, and plans. 



Copi es : 35 copies of the proposal and curricula 
vitae of all except clerical personnel must 
be submitted to be read by an evaluation 
commit tee . 



Budget : The budget is not to exceed $40,000 
for the time period, July 1, 1971 to June 
30, 1972, 



De adlines : Proposals are to be submitted 
by Hay 31, 1971. 



Those institutions interested in 
submitting proposals are required to verify 
this by a letter of intent to be sent before 
May 1, 1971 

Decisions regarding proposals will be 



Criteria for Selection? The follov7ing 
questions will be sent to tha selection 
comini t tee : . 

© Does the proposal respond to 
the specif icat ions V 

o How well are the proposal objective 
addressed to t ha Department ' s 
priorities and the needs of the 
students in occupational education' 

© How clearly .are the objectives of 
the program spelled out? 

© How readily can the attainment of 
these objectives be assessed? 

6 Would you suggest any modification 
in the number and /or type of 
activities to make this evaluation: 
more effective? 

o Are the proposed activities 

appropriate in terms of the goals 
of this product -oriented evaluatioi 



made on June 15, 1971. 
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From the budgetary informntion 
provided, would you recommend full 
or partial funding? How much? 

If only a part of this project 
is adequate, which pa-i^^t vould 
you consider better than 
corresponding parts of the 
other competing projects? 

Do you feel that the description 
of the final do.cuments to be 
produced by this project is 
adequate? 

What suggestions have you for 
improvement if this proposal is 
chosen? 

In what way can the results of 
this proposal lead to improved 
vocational teacher education on 
a Statewide basis ? 

Does this proposal overlap with 
any other State or Federal 
activity? What effect would this 
have on funding? 

Choose one: This project: 

(a) is highly recommended, 

(b) is recommended, 

(c) should, be rejected, 

(d) is recommended subject to 
the following modifications. 
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EDUCATIONAL ISSUES : VThat to Do 

V/hen the Experts 
Disagree with One Another 



An issue in Education is often an area where it is difficu 
to find unanimity even among the experts. Ordinarily, these areas 
are comprised of situations where each alternative leads to a vastly 
different conception and scale of values. 

It is not always possible to avoid the dichotomy caused by 
the typical educational issue. However, it is hoped that the use of 
performance objectives in defining the scope of an issue will remove 
any uncertainty caused by fuzziness of terminology. 

A few typical unaswerable questions have been chosen to 
give examples of the new type of interaction that develops when 
performance objectives are used to clarify issues. 



issues : Unanswgrc'J Questions 



A number of questions arise whenever 
one tries to suggest that there is a 
better vay of describing occupational 
education. 



TEACHER CERTIFICATION 



Academic Credentials and 



TEACHER CERTIFICATION 



the Ability to Earn a Living 



Q What must we look for V7hen trying to 
certify an occupational- teacher? 



CURRICULUM MODULES 



• Is the one semester or two semester 
course the most effective way of 
dividing up a- course of study? 



The exercise of a trade or occupation 
.necessarily demands a certain amount of 
knowledge accompanying the skill by which 
one earns one's living. As can be seen in 
the case of the awkward savant, the more 
possession of knov^ledge does not necessarily 
imply the ability to perform the skill 
concerned. 



COURSE PREREQUISITES 



& What type of prior demonstrable 

knowledge must a trainee or student 
have before being allowed to take 
a particular advanced course? 



Similarly, a person who acts merely 
from memory will function acceptably as long 
as no need to think arises. But when 
exceptions occur, the unthinking automation 
will fall to pieces and possibly kill 
himself on complicated machinery. 



CURRICULUM DEVELOPMENT 



o Is there a practical and reasonably 
priced method of keeping occupational 
curricula up-to-date and effective? 



REQUIRED COURSES 



Society demands competent teachers and 
competent workers. A society that prevents 
non-diplomaed workers from teaching is 
perhaps failing to recognize communicable 
knowledge that was learned outside the school 
house. A variety of people have learned a 
variety of things in a variety of ways and 
places, only one of which has been the school* 
This fact must be expected to recognise all 
the potential teachers available at a given 
moment. 



o How can required courses in math 
and the basic sciences be developed 
in a way to maximize benefits to 
occupational students^ 



lOU 



The Basic Question ' 

This question emerges in another form: 

o "Does the performance required of 
an occupational teacher demand that 
he possess an academic degree?" 

This question is difficult to ansv7er 
since an academic degree is more often 
de-fined in terms of courses than in terms of 
skills acquired. Unless a course is defined 
In terms of skills gained, the mere completion- 
of a course is not a guarantee of the ability 
to perform. 

When one begins to think in terms of 
performance objectives, one stops asking the 
question: 

© • "Has this prospective teacher a 
college diploma or a teaching 
certificate?" 

Instead, one begins asking two questions: 

© "What does our ogranisation expect 
a teacher to be able to accomplish?" 
and , 

o "Has this prospective teacher the 
expected capabilities in these 
specified domains?" 



CURRICULTM MODULE S 

Trying to Squeeze the Most Occupational 
Benefit out of Smaller Units of Time 



Than the Semester 



A curriculum can be vievjed as an 
assembly of semester or two-semester courses 
each of which contributes to the desired 
^.end-product. 

This assumes that each essential 
component can be provided by one or more 
courseSo Depending upon the course content, 
this may or may not meet the requirements of 
the student following a particular curriculum. 
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There are other ways to divide up a course 
of study. For example, the construction of 
performance goals for instruction based on 
anticipated terminal capabilities allows for 
the expression of course content in clear and 
unambiguous language « 

A collection oi closely related performance 
objectives is called a module. As selfstanding 
building blocks, modules provide a flexibility 
necessary to prepare students for more precise 
career ladders o If course content is identified 
in terms of performance objectives, the segments 
of a course can be used in a number of ways. 

Utilizing such a system, it would be 
possible to identify the particular v;elding 
skills, machine skills, layout skills, or the 
like^ needed for performance in a particular 
job family^ It would not be necessary to take 
full courses in each area. 

Why This Smaller Time Unit Helps 

This approach would aid individualisati on 
and personal counseling, and realignment of 
goals would be easier since students would not 
be locked into a program. Goal. aspirations 
could be modified upward or downward as 
competencies are revealed through frequent 
checks on performance. 

It sometimes happens that only a part of 
a course is essential to the needs of the 
student o For example, students have taken 
complete courses in welding because there are 
certain welding operations that these students 
must learn for their chosen career. 

When operations other than those directly 
related to on-the-job welding have been presented 
in the course, certain students develop the 
attitude, "Why should T study things I'll never 
need to know after the final exam." 

Similarly, their curriculum planners have 
begun to say to each other, "Certain full 
semester courses are teaching topics not 
essential to our occupation and thus using up 
time which could better be devoted to other 
topics need by our students. " 
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Almost subconsciously, both students 
and curriculum planners are shifting the 
emphasis from courses to competencies. This 
is the first step to v^ritlng performance 
objectives* 



The Rationale 



When one course is a prerequisite of 
another course, the assumption is made that 
success in the second course depends upon 
success in the first course , 

In practice, some students vjho receive 
a grade for a prerequisite course do... not 
learn all the basic skills required for the 
next course. 



The welding teacher may be willing to 
accommodate these specialised students from 
-a particular occupation but he needs more 
precise instructions than "Teach a v;elding 
course geared to this particular occupation," 

He needs someone to tell him by job 
analysis exactly V7hat operations are 
necessary and to V7hat extent they must be 
taught . 

With these specifications, the teacher 
will know exactly what he js expected to 
teach and the students will know exactly 
what they are expected to learn a long time 
before the final exam. 

One form of developing these specifications 
is known by the names of "performance objectives" 
or "behavioral objectives," When a group of 
related performance objectives are grouped 
together in an instructional unit, a "module" 
emerges* 



C OURSE PREREQUISITES 

Starting to Think in Terms of Trainee 
Abilities Rather Than^ ^'in Terms of 
Student Transcripts of Courses Completed 



The approach taken by this section is 
quite simple: 

e One of the more visibly verifiable 
ways of demonstrating the reasons 
behind prerequisites is to present 
course prerequisites in performance 
objective terms „ 

0 This goes to the heart o,f the issue 
and tries to spell out the structure 
of the objective involved by shovjing 
how it builds upon previous objectives, 



One reason for this is that the teacher 
of the prerequisite course wbs never told 
precisely what he was to do. The reason 
he was never told is r> imply that his course 
was described in vague, gexieral terms 
instead of in performance objective terms. 

It is not always necessary or 
desirable that every detail be spelled out. 
However, if the most important components 
of a prerequisite course are not specified 
in clear and concrete language, the second 
course in the series will possibly be 
building on sandc 



CU RRICULmi DEVELOPMENT 

S^'j itching from Pa perwork t^o Decision- 
Maki ng Both by Cu rric ulum Sp ecialities 
and by Classroom Teachers 



When one considers the fast pace of 
the development of knowledge in the -1970 
the problem of curriculum development is 
not that of writing curriculum but that of 
revising and updating curriculum. 

Seen from this perspective, a few 
simple guidelines emerge: 

o Curriculum development, if it is 
to fulfill Its mandate of being 
up-to-date and practical, really 
boils down to staff development , 

o It is more important to establish 
a mechanism or system of updating 
and improving stated objectives 
than to attempt to start off with 
perfectly written objectives. 
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© When curriculum development changes 
from telling the clnssroom teacher 
exactly v;hat, v^hcn, and how to 
t^acji, and instead asks him, "What 
has your teaching experience taught 
you is possible and practical on 
the classroom level?" then the 
teacher is being treated and also 
being developed as an expert. 

Typical Obstac les to Overcome 

Here are typical objections and 
dlf f iculities that emerge when a teacher 
tries , to do too much .V7riting and not enough 
deciding in writing perfornlance objectives: 

o "Our school doesn^t have enough 
money to release teachers to 
vrite objectives." 

0- "Our best teachers are too busy 
teaching to have time for. all 
this paper work." 

o "Performance objectives are very 
helpful but the excessive amount 
of details they demand make the 
process of their construction 
much too dullo " 

© "Now that we have written all 
these performance objectives, 
the classification system necessary 
to get them on the computer is too 
complicated and is obviously 
unrelated to the local needs of 
our school and students," 

Each one of these objections is very 
real for the teacher who has started to write 
performance objectives without any real idea 
of what this method can do to improve detailed 
classroom instruction. 



Slowly 

Slowly means that the teacher will 
get better results if he or she tries to 
put down on paper only two or three of the 
most important objectives of his course^ 

Once his is accustomed to planning 
course objectives, testing items, and 
learning media at the same time rather 
than piecemeal, he will be able to expand 
the explicitness of his v^ritten performance 
objectives without too much difficulty. 



Me t hod ic a 1 ly 

Methodically means that the teacher 
will be able to' detail his approach by 
employing feedback from other schools « 

Once his objectives are codified he 
vill be able to retrieve objectives used 
by other teachers in similar courses. . 

Most courses have cognitive and mental 
goals; they also have affective and 
attitude goals; they also have psychomouor 
and manipulative skill goals*, Each of 
these three areas can be codified in a 
manner to help improve teaching: 

£2.8^iL^Y£. — ^^"^^ teacher says 
that one of his classroom goals is 
creativity, this would receive a 
specific code number. 

If the test item used by the 
teacher to measure this goal is strictly 
a memory recall item, this would receive 
another code number. 

By this classification system the 
inconsistent teacher will be forced to 
admit that he is grading the majority of 
his students strictly on memory even 
though he really wants to evaluate them 
on creativity. 



Slow , Methodical , and Pragmatic Decisions 



Require Much More Than Paperwork 



To get the maximum benefit out of 
performance objectives a teacher must move 

into the system slowly, methodically, and 
pragmatically. 
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A Ii°LE£ 511 Relevance The very fact 
that teachers come to grips with objective 
writing is a positive step toward relevant 
instruction. The first step is sometimes 
the hardest , 



ACfectivo Most courses have goals 
that deal v;ith desirable attitudes and good 
human relations. 

A performance objective system will 
analyze by code number all the test items, 
classroom activities, and classwork required 
of the student. 

If none of these activities can be 
classified as affective, the teacher will be 
forced to admit that he has overlooked 
Oieasuring the desired attitude change he 
claims he wantSo 



Psychomotor Some occupational teachers 
contend tliat their goals are primarily 
psychomotor. 

A careful classification of ' tslieir 
objectives and evaluation methods will force 
them to realize that related cognitive -and 
affective skills are also necessary f^in.d to 
realize that the psychomotor domain often 
involves more than brute force and sometimes 
less than the precision touch of an artist 
or surgeon p 



Combinations of Cop;ni tiy e^ Affective, 
and Psyc-ltomo tor Certain repetitive 
psychomotor tasks can become boring to an. 
uninterested student or a young beginning 
worker. 

Normally, this type of work involves 
an affective component: a bored worker will 
be sefin slouching against his machine in a 
manner that his supervisor or foreman would 
call - 'slovenly. " 

Rather than try to settle once and for 
all- whether a worker's sense of identity 
and his self-concept is a question of the 
affective or of the cognitive domain and 
rather than try to decide whether a worker 
. is bored consciously or subconsciously, it is 
often very practical to realize that many 
- workers simply don't know on the cognitive 
level what to do to avoid being bored or to 
avoid giving the impression of being bored. 

A fully thought-out course of study 
expressed in performance objective terms 
could address itself to this problem without 
getting bogged down in psychological 
distinctions. 
O 
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Pragmatically 

Pragmatically means that instead of 
spending too much time writing too much 
detail and too much classification, the 
teacher constantly as-ks himself this 
question : 

0 "Is all this work worth the extra 
effort?" 

Depending upon his answer he will 
continue or drop the project with a better 
spirit of understanding. 

REQUIRED COURSES 

Fillin g-in the Theoretical Princ ipl es . 
with Applications Cho s en from Actual 
Courses and Programs -i n 0 c c up a t io na 1 
Education 

The development of. common core courses ; ; 
in such things as math and the basic^^g/iences 
is nothing new in occupational education. 
Not all of the suggested approaches have 
been successful. 

Typically, an expert (often assumed 
to be anyone with a Ph. D. in a particular 
subject matter) was the one who put these 
courses together . 

, This often involved three phases: 
s-election, evaluation, and teaching. 

The Three Components 

'•^^^ choice of what to learn was made 
by the experts vho had to answer the 
question: 

o "What is the most important 
subject matter?" 

The evaluation of this selection was 
often made by learning psychologists who 
had to answer the question: 
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® "Are the students able and ready 
to learn this subject matter?'' 

The teaching had to fee done by teachers 
vho V7ci*e given two directives: 

0 *'Your approach must be practicall" 



o Motivation is not everything, but 
with a student of average or 
above-average ability, it can mean 
the difference between the bare 
minimum learning or learning up . 
to the student's ability. 



"Your students must be motivated!" 



Teaching 



The Three Difficulties 



Choice 



A number of difficulties emerge when 
one considers the implementation of the 
chosen subject matter: 

o Some students choose their 
curriculum on the basis of 
their self-concept instead 
of on the basis of an, analysis 
of their capabilities and 
learning potentialSo 

0 Some teachers choose the 
elements of the curriculum 
they teach on the basic of 
their ovm job experience' to 
the exclusion of other 
practical applications. 

© Such choices are often ill- 
founded unless someone steps 
in to add a dose of reality. 



Evaluation 



The matter becomes even more complicated 
when one considers the case of the -average 
classroom teacher v;ho has never been told 
exactly what to teach: 

0 The beginning t eacher is often 
given a curriculum guide which 
tells the contents of the course 
of studies without giving any 
specific examples of what this 
means in terms of day-by-day 
classroom instruction. As g - 
result, he merely tries to do 
the best he can, 

o The experienced teache r is used to 
curriculum changes. Unless these 
are spelled- Cut in terms of 
specific procedures or equipment 
changes, the}^ are usually filed 
away without any observable change 
in classroom performance, 

o The i ndependent teacher can become' 
just as complicated. There are ♦ 
studies which suggest that teachers 
teach less effectively when the}^ 
feel they are merely dolling out 
subject matter chosen by someone 
else. 



Another difficulty emerges when one 
considers the criteria applied to determine 
whether or r\ot a particular math or science 
course is practical and interesting: 

o It is possible for a curriculum 
that has satisfied subject matter 
specialists and learning psychologists 
to fail the evaluation of students 
who are easily bored „ 

o Trying to specify course goals with 
the student in mind gives an orienta- 
tion that "Actions speak 
louder tlian words in motivating or 
evaluating others." 



e What is needed is a system that 

provides the classroom teacher with 
the opportunity t_o select his own 
classroom objectives from the 
successful experiences of others and 
to feel free t£ spell o ut his own 
goals^ in terms that can be evaluated 
by classroom ef f ect iveness „ 

Once objectives are spelled out, it is 
easier for the teacher to develop test items 
to evaluate student progress tov;ards these 
goals. It is also easier for the ^ teacher 
to evaluate the methodology he used to 
reach the objective. 
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The First Steps in This Direction 



Working TogGther 



Only after a teacher has gone through 
the piecemeal effort required in v?riting 
and classifying performance objectives, is 
he able to start building something vrith 
them* 

A very practical example comes to 
mind when one considers common goal courses 
such as physics, chemistry, and mathematics, 
that many occupational students are required 
to study. 

These courses v;hich have been chosen 
by experts are often met with the following 
typical student objections: 

o "These courses aren*t practical 
to my future career 

& "This course tries to cover 
too much." 

a "This course is too theoretical." 



These objections are very often 
unanswerable by the classroom teacher v?ho 
did not have much clioice in the selection 
of the course content or in the selection 
of the stiji^ents v;ho take the course^ 
i\ 

Objectives which have been classified 
for a nimiber of different occupational 
curricula obviously have various common 
elements. When tliese common elements are 
spelled out in performance objective terms, 
it V7ill be possible to state categorically 
that certain principles of physics ^ chemistry, 
mathematics, and other sciences are necessary 
for a majority of occupations. 

Other principles of sciences will be 
found necessary only for certain other 
occupations. 

Once all these related science areas have 
been identified and classified it will be ^ 
possible to construct a course that presents 
these objectives as the primary subject 
matter. From at least the viev/point of the 
application of knowledge, this is another 
step towards improving the perceived 
pertinence'' of a general education course 

^.he student's occupational goals. i 



Given a system'. of performance 
objectives written by classroom teachers, 
subject matter specialists will be able to 
add another dimension to -their choice of 
the most important things to teach. 

Armed with this information, school 
administrators and learning psychologists 
will be able to zero in on the most 
scientific methods of teaching and 'learnings 

Once this sort of feedback is 
established, teachers will be able to make 
their classroom and group instruction more 
practical and humanistic . 



PERSPECTIVE ; 

Necessary Thrusts for the 
Im p r oveme nt of Learning and 
the Relevance of Instruction 



The last two sections on Curriculum 
Development and Required Courses have 
spent much time on codification and 
course development. 

All this is well and good, but it 
must never be forgotten that, when one 
claims that curriculutn development means 
staff development, staff development 
means the improvement of the teacher's 
ability to teach ia a classroom situation. 
Staff development through performance 
objectives means more than only the 
teacher's increased ability to put 'down 
on paper exactly what he is trying to 
achieve. 

The thrust of performance objectives 
is improvement of the teaching-learning 
process. Certainly one goal in all 
courses is the improved ability of the 
student to learn for himself; this is 
included in the more general goal of 
improving the teacher's ability to teach. 



ACCOUNTABILITY: On an 

Ind ividual, 
Voluntary, and 
Confidential Basis 



Educators have, long been interested in the link between 
educational dollars spent and educational learning achieved by students. 

In the 1970* s, the pendulum has swung from observing what 
teachers do in the classroom to measuring pupil growth. This has. 
occurred against a background of accelerating costs, mediocre academic 
performance of disadvantaged children, and inconclusive results of 
extra dollars spent trying to catch up. 

With the introduction of performance objectives, accountability 
becomes a personal thing. The teacher specifies V7hat he is trying to 
do, then receives feedback • evaluative information, and proceeds to better 
his own score according to a system he has freely chosen. 
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Tiic Typi cal Approach to Qool Writing 



Individual Accountability 



Writing performance and behavioral 
objectives is ^ot a new activity on the 
educational scene^ 

A large amount of effort has been 
expended in writing up objectives to cover 
a wide variety of courses. This has led 
to several rules of thumb that can help 
avoid comnion pitfalls. 

© Decisions must take precedence 
over paperwork. Too much writing 
has often obscured the necessary 
decisions that must precede putting 
objectives down on paper« 

9 Objectives should he written that 
stress significance ns well as 
detail.; Irrelevant objectives 
result v;hen teachers start to 
write before askln?^, , "Is this 
v?hat I really want to teach?" 

o Objectives should be bounced off 
the objectives of other teachers 
■ ' teaching the same courses. The 

feedback necessary for improvement 
occurs when teachers compare and 
exchange ideas. 

o Achievement is not always the same 
as test-awaren>«s. Objectives 
closely linked to test items can 
be misconstrued as an invitation 
or imperative to teach to an 
exam as an unalterable standard. 

• Objectives constructed by juries of 
experts must be used judiciously. 
The classroom teacher should be 
treated like an expert; after all, 
he is a professional. He docs not 
have to be told exactly what to do 
every step along the way. He is 
the one who can give practical cues. 

This short listing makes it obvious 
that more than writing perfomiance objectives 
is necessary to improve classroom instruction. 
It must be remembered that the classroom 
is the place where progress must be made if 
it is to be more than theoretical. 



The tecicher is treated as a professional 
possessing adequate and expert knowledge: 

© He decides exactly what he wants 
his students to learn and to be 
able to perform at the end of 
his ins truct ion, 

e He does this by choosing objectives 
from a bank of possible goals and 
by V7riting himself objectives that 
he feels meet the needs of individual 
students « 



yoluntary Accountab ility 

The teacher sets up the scoring or 
evaluation system: — — 

e He decides the type of examination 
and, evaluation which will best meet 
the educational requirements of his 
students 

o He docs this by choosing appropriate 
itemsS from a computerized file or 
from his own cross-referenced set 
of items he has specifically 
written for a particular objective 
in one of his courses. 

© He is not told vjhat to teach or what 
to measure, but he is asked: 

Q "Exactly what do you intend to 
teach?" and, 

0 ^'Exactly how do you intend to find 
out if you have been successful?'' 

V 

Confidential Accountability 

The 63^stem has built into itself 
safeguards against teacher ranking and 
teacher evaluation: 

• The teacher, and not the system, 
decides exactly what data goes 
into the system and what data is 
released « 

9 The teacher decides whether his rate 
of growth and improvement is satis- 
factory or not, and he decides what 
he' wants to do about It. 



QUALITY : How to Recognize Excellence 
as the Accomplishment 
of Clearly Stated Goals 



The typical approach to improved classroom instruction 
has been the imposition of better goals upon teachers. Sometimes, 
this comes from a state curriculum. Other times, tills comes from 
the Imposed will of the majority of one*s colleagues. Not 
infrequently, current issues force their way into the classroom. 

In each of these situations and others wherein the 
classroom teacher is not the one who chooses his own instructional 
goals, there is the possibility of less effective results. There 
are many teachers who can successfully and almost effortlessly 
teach goals put forth by others. There are many other teachers v/ho 
find the imposition of goals an affront to their professional 
ability to choose goals and to evaluate their results in attaining 
them. This imposition nf goals and evaluation from a vague exterior 
source can become a source of threat for many teachers. 

Performance objectives means that the teacher clarifies the 
goals he has chosen or written; it is not a method of imposition. 
Aft^r a goal has been clearly identified, quality is recognizable. 

iOu 



AFFECTIVE DOMAIN : Developing Core Objectives That Pinpoint 

Attitudes Necessary for All Occupational 
p Areas RelaCed to Entry Level Occupations 



The typical occupational student has ch'osen a specialty at 
a comparatively young age and at a time when he does not have too 
much familiarty v;ith the world of V7ork. If serendipity works in his 
favor, there is" no difficult'-y. The problem arises from a very simple 
fact : the typical entry level beginning job is often taken in a 
field for which the applicant has not been trained. 

It's not so much that these trainees are dissatisfied with 
their teachers or counselor.s. It's* simply that the growing-up process 
has taught them that their interests lie' elsewhere. Their training 
has not been lost since they have picked up good work habits and 
attitudes which will improve the chances of success on any job. 
This brings up the question, "Is it possible to identify these 
core attitudes and skills which stress versatility and job clusters 
rather than specific trade-linked performances?'' 
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Extending This Approach 
to Typical Adaptations 
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GRADUATE SCHOOL : The M.A- Developing the Graduate 

Frame of Mind Through Recognizable and 
Readily Evaluated Performance Objectives 



The difference between unde r-graduate and graduate education, 
should be more than a difference of quantity. If the principal norm 
of the gveAuate school is more course requirements j more and longer 
term papers, more books to read, more information to memorl?:c, more 
questions on the oral examination, and more difficult entrance exam.s , 
then the graduate student is possibly not being educated to function 
on a higher level of operation even though he is being given a thorough 
training. The ability to perform activities on a qualitatively higher 
level is not an easy thing to define* 

This is where performance referenced criteria come into the 
picture. One of the most obvious starting places would be to observe 
professionals generally recognized as superior in their profession. 
The graduate student might spend a lot of time observing, but possibly 
this might be a better activity than merely memorizing a large array 
of information he may never need or use. 



THE COLLEGE PRESIDENT : The Role of the College President 

Towards Objectives Structuring 
a College for Growth Rather Than 
Relying Solely on Charismatic Leadership 



Higher Education is a domain all unto itrself. The President 
is the man who must be aware of its own special demands. If^ the 
college is small, the President must decide v/netlicr or not to make 
it larger. If the college is large, the President must decide on 
how to tic it all together. If the college is going into debt, the 
President must get it back on its feet. Depending upon his power or 
lack of it, the College President can find himself in a number of 
painful s i tuations ; for example , he is the one left to Implement the 
decisions of the board of trustees even when they may be against his 

' mm''^re'f erences . 

. The College President thinks in terms of goals, sometimes 
chosen by himself, other times chosen by others. If his goals are 
not clear, he will find himself wondering where he is going. 

ERIC 



IHE ROLE OF THE 

COLLEGE PRESIDED T 



Structuring £ College for Grot^th 

- T-here are a. number of sources for ideals 
and goals a college could pursue; 

» 

e ..Newman, Idea of £ Univers ity , 

^ o Gardner, Excellence , 

o Lessinger, Accountability , 

o Mager, Analyzing Perf ormaxice Problems 

This list is by^no means selective or 
all inclusiveo 

However, it does indicate an approach 
which various educators have set up a continuum 
from one intellectual ideal for all (Newman) to 
an ability to adapt to modern times (Gardner) 
to thinking of education in terms of how much 
product per dollar (Lessinger). Then, there 
are others like Mager who ask the questions: 

o "What are you trying to do?" and^ 

o "How well are you doing it?" 

The Current Situation 



In addition to the current problems facing 
all instiutions of higher education, the small, 
private, liberal arts college has a vjhole set 
of its own problems : 

homogeneity Sometimes, all small 

colleges begin to seem more and more 
alike; often this can be a sign that 
a college is also becoming more and 
more like a university prep. 



ownership and direction Once a 
board of trustees is set up, it 
is difficult to be sure who has 
the final word, trustees or a semi- 
proprietary body as in the immediate 
past. 

I 

s tze — Many small colleges want to 
grow in size; often the upward 
limit of this grov7th is left hazy 
and undefined. 

faculty — This often represents the 
major yearly financial outlay; on 
the other hand, it is the major 
source of student learning and 
satisfact iono 

future — It is certain that there will 
always be good private colleges; but 
just recently, a number of good 
private colleges have closed doors, 
and for a number of reasons, not 
all of them financial or academic o 

stu dents It would not be unusual to 
find teachers and administration 
seeking to have only the best for 
the ranks of the student body. Yet 
it can be asked whether or xiot this 
should be a goal or an expectationo 

Tlie Charisma tic Leader ' 

Often, a search for a college president 
is a search for a charismatic leader who 
will be able to mold an institut Ition in a 
workable extension of his personalityo 

The position herein taken is a bit 
different : 

o to set up goals for a small liberal 
arts college is difficult 

9 no ready-made solution comes to mind 



TOWARDS 0 B ' J E C T I V E 
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liberal arts — There is something to 
be said for the position that too 
many small colleges seem to think 
that all their students are of ivy 
league caliber, too rich to need 
occupational preparation . 

^Q^^Q — The really well known small- 
, colleges are not hit especially 
hard by the cost squeeze; their 
clientele, and reputation take care 
of this. 



however, an honest attempt to admit 
the local difficulties to growth 
and to set up a few modest goals 
might be the first step 

without seeing the college In depth, 
no Indication can be given as to 
where 'to begin, hov;ever, hints of 
solutions that come to mind give 
this difficult task the allure of 
a challenge that could be exciting. 
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ON-GOING PROJECTS : Brief Resumes of What Others Are 

Doing Co Present Their Programs in 
Terms That Can Be Understood by a 
Larger Audience Than That of 
the Specialised Researchist 

The success of any educational project, like that of any 
form of experimentation, depends upons an unique couibination of 
two rare natural coirunoditles ; expertise and couimon sense. Sometimes, 
as in the case of abstract formulas > coinmon sense find<; that it is 
not the best criterion. Other times, as in the case of abstruse 
speculations divorced from reality, cxpertlfle has found itself lost 
in situations where the man on the street would have knov;n what to do. 

Both the researchist and the consumer of research have much 
to give to each other. For any meaningful exchange to take place, 
dialogue must be established. This will be difficult unless both 
speak the same language; by necessity, this language must be clear 
and unambiguous even when talking about very tentative alternatives. 
The projects cited herein have started this dialogue by trying to 
keep their language simple v;hile aiming at .excellence. 



